- Chi tiết công việc
- Giới thiệu công ty
Vị trí công việc này hiện tại đã hết hạn nộp hồ sơ, bạn có thể tham khảo thêm một số công việc tương tự tại đây:
Mô tả công việc
An accomplished Data Platform Engineer is desired to become a member of our dynamic team. The optimal candidate should have substantial knowledge and experience managing workloads on EC2 clusters using DataBricks (EMR or an equivalent level of experience will suffice), ensuring connectivity and data availability via Data Mesh, implementing least privileged access across AWS accounts and Databricks data platform, and operating distributed engines such as Spark. Furthermore, storage technologies, data orchestration, and CI/CD pipeline, and operational experience with Spark and other data warehousing tools are prerequisites for success in this position.
Your responsibilities
Manage, capacity plan, and operate workloads utilizing EC2 clusters via DataBricks/EMR to ensure efficient and reliable data processing
Collaborate with stakeholders to design and implement a Data Mesh architecture across multiple closely related but separate enterprise entities
Utilize Infrastructure as Code (IaC) tools such as CloudFormation or Terraform to define and manage data platform user access to data and compute resources.
Implement role-based access control (RBAC) mechanisms using IaC templates to enforce least privilege principles and ensure secure access to data and compute resources
Collaborate with cross-functional teams to design, implement, and optimize data pipelines and workflows
Utilize distributed engines such as Spark to process and analyze large volumes of data efficiently when required
Develop and maintain operational best practices for Spark and other data warehousing tools to ensure system stability and performance
Implement and manage storage technologies to efficiently store and retrieve data as per business requirements
Troubleshoot and resolve platform-related issues in a timely manner to minimize downtime and disruptions
Stay updated on emerging technologies and industry trends to continuously enhance the data platform infrastructure
Document processes, configurations, and changes to ensure comprehensive system documentation.
Your responsibilities
Manage, capacity plan, and operate workloads utilizing EC2 clusters via DataBricks/EMR to ensure efficient and reliable data processing
Collaborate with stakeholders to design and implement a Data Mesh architecture across multiple closely related but separate enterprise entities
Utilize Infrastructure as Code (IaC) tools such as CloudFormation or Terraform to define and manage data platform user access to data and compute resources.
Implement role-based access control (RBAC) mechanisms using IaC templates to enforce least privilege principles and ensure secure access to data and compute resources
Collaborate with cross-functional teams to design, implement, and optimize data pipelines and workflows
Utilize distributed engines such as Spark to process and analyze large volumes of data efficiently when required
Develop and maintain operational best practices for Spark and other data warehousing tools to ensure system stability and performance
Implement and manage storage technologies to efficiently store and retrieve data as per business requirements
Troubleshoot and resolve platform-related issues in a timely manner to minimize downtime and disruptions
Stay updated on emerging technologies and industry trends to continuously enhance the data platform infrastructure
Document processes, configurations, and changes to ensure comprehensive system documentation.
Yêu cầu công việc
Knowledge of one or more of the following AWS CloudFormation and Terraform for infrastructure provisioning
Knowledge of the source control and its related concepts (Gitlab/Git flow, Trunk base, branches, etc.).
Experience with CI/CD tools (such as Jenkins, TeamCity, AWS CodePipeline, CodeDeploy) or configuration management tools (such as Ansible, Chef, Puppet..)
Familiarity with at least one programming language (Python, Bash,etc.).
Familiarity a distributed compute engine such as Spark
Familiarity with a data platform or data orchestration tool such as Databricks/Airflow
Equipped with in-depth working knowledge and experience in using AWS IAM, VPC, EC2, RDS, DynamoDB and S3
Knowledge of networking, IP, endpoints, firewalls, load balancers, high availability, etc..
Basic skills around monitoring, observability, and building system dashboards are desired
DevOps mindset with automation and operation excellence in mind
Good skills in English and the ability to communicate effectively with business and technical teams
Demonstrate good logical thinking and problem-solving skills
Be curious and self-learning attitude
AWS Certifications (Big Plus)
You are:
Passionate about technology
Independent but also a team player
Comfortable with a high degree of ambiguity
Focused on usability and speed
Keen on presenting your ideas to your peers and management.
Knowledge of the source control and its related concepts (Gitlab/Git flow, Trunk base, branches, etc.).
Experience with CI/CD tools (such as Jenkins, TeamCity, AWS CodePipeline, CodeDeploy) or configuration management tools (such as Ansible, Chef, Puppet..)
Familiarity with at least one programming language (Python, Bash,etc.).
Familiarity a distributed compute engine such as Spark
Familiarity with a data platform or data orchestration tool such as Databricks/Airflow
Equipped with in-depth working knowledge and experience in using AWS IAM, VPC, EC2, RDS, DynamoDB and S3
Knowledge of networking, IP, endpoints, firewalls, load balancers, high availability, etc..
Basic skills around monitoring, observability, and building system dashboards are desired
DevOps mindset with automation and operation excellence in mind
Good skills in English and the ability to communicate effectively with business and technical teams
Demonstrate good logical thinking and problem-solving skills
Be curious and self-learning attitude
AWS Certifications (Big Plus)
You are:
Passionate about technology
Independent but also a team player
Comfortable with a high degree of ambiguity
Focused on usability and speed
Keen on presenting your ideas to your peers and management.
Quyền lợi được hưởng
You'll love working with us if you are:
Passionate about technology.
Independent but also a good team player.
Comfortable with a high degree of ambiguity.
Focused on usability and speed.
Keen on presenting your ideas to your peers and management.
At TYME, opportunities are here for the taking. If you want to be part of our purpose and live and lead through our values, we can offer exciting development opportunities through expanded lateral roles, stretch assignments, or people leadership.
Some of our benefits:
Meal and parking allowance are covered by the company.
Full benefits and salary rank during probation.
Insurances as Vietnamese labor law and premium health care for you and your family without seniority compulsory
Performance bonus up to 2 months
13th month salary pro-rata
15-day annual leave+ 3-day sick leave + 1 birthday leave + 1 Christmas leave
SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
Values-driven, international working environment, and agile culture.
Overseas travel opportunities for training and working related.
Internal Hackathons and company's events (team building, coffee run, blue card...)
Work-life balance 40-hr per week from Mon to Fri.
Passionate about technology.
Independent but also a good team player.
Comfortable with a high degree of ambiguity.
Focused on usability and speed.
Keen on presenting your ideas to your peers and management.
At TYME, opportunities are here for the taking. If you want to be part of our purpose and live and lead through our values, we can offer exciting development opportunities through expanded lateral roles, stretch assignments, or people leadership.
Some of our benefits:
Meal and parking allowance are covered by the company.
Full benefits and salary rank during probation.
Insurances as Vietnamese labor law and premium health care for you and your family without seniority compulsory
Performance bonus up to 2 months
13th month salary pro-rata
15-day annual leave+ 3-day sick leave + 1 birthday leave + 1 Christmas leave
SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
Values-driven, international working environment, and agile culture.
Overseas travel opportunities for training and working related.
Internal Hackathons and company's events (team building, coffee run, blue card...)
Work-life balance 40-hr per week from Mon to Fri.
Nộp hồ sơ liên hệ
Tyme
Giới thiệu công ty
Xem trang công ty
Overview about Tyme Tyme is building multi-country digital banks with high-tech and high-touch solutions. Tyme Vietnam is the international arm of Tyme Group with operations in Hong Kong, Vietnam, The Philippines, and South Africa. We own the technology platform and intellectual property globally...
Quy mô công ty
Từ 101 - 500 nhân viên
Việc làm tương tự
CÔNG TY CỔ PHẦN GREENFEED VIỆT NAM
Cạnh tranh
09/05/2024
Hồ Chí Minh
Ngân hàng TMCP Phát triển TP.HCM - HD Bank
Thỏa thuận
30/04/2024
Hồ Chí Minh
Flywheel Digital
Thỏa thuận
11/05/2024
Hồ Chí Minh
Eatlab co Ltd
Thỏa thuận
11/05/2024
Hồ Chí Minh
KiteMetric
27 - 57 triệu VNĐ
26/05/2024
Hồ Chí Minh
hỗ trợ doanh nghiệp
Giải thưởng
của chúng tôi
Top 3
Nền tảng số tiêu biểu của Bộ
TT&TT 2022.
Top 15
Startup Việt xuất sắc 2019 do VNExpress tổ chức.
Top 10
Doanh nghiệp khởi nghiệp sáng tạo Việt Nam - Hội đồng tư vấn kinh doanh ASEAN bình chọn.
Giải Đồng
Sản phẩm công nghệ số Make In Viet Nam 2023.