Senior Data EngineerCông ty TNHH Got It
Hình thức: Toàn thời gian
Ngày đăng: 20/05/2024
Hạn nộp: 20/06/2024
Vị trí công việc này hiện tại đã hết hạn nộp hồ sơ, bạn có thể tham khảo thêm một số công việc tương tự tại đây:
Mô tả công việc
Mô tả công việc
Tóm tắt công việc
We are seeking a Senior Data Engineer to play a pivotal role in building our data platform from the ground up. You will be responsible for designing, developing, and deploying a scalable, secure, and open-source based data platform on the AWS cloud. This is a unique opportunity to shape the future of our data infrastructure and empower data-driven decision making across the organization.
Design and implement a robust data platform architecture on AWS, leveraging open-source technologies whenever possible.
Evaluate and select appropriate open-source tools and services for data ingestion, transformation, storage, and analytics.
Develop and maintain data pipelines for efficient movement and processing of large datasets.
Ensure data quality and consistency throughout the data lifecycle.
Implement data security best practices to protect sensitive information.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate them into technical requirements.
Automate data platform tasks and processes for improved efficiency and reliability.
Monitor and troubleshoot data platform performance to identify and resolve issues proactively.
Stay up-to-date on the latest trends and technologies in the data engineering space.
Document data platform design, architecture, and processes for future reference.
Tóm tắt công việc
We are seeking a Senior Data Engineer to play a pivotal role in building our data platform from the ground up. You will be responsible for designing, developing, and deploying a scalable, secure, and open-source based data platform on the AWS cloud. This is a unique opportunity to shape the future of our data infrastructure and empower data-driven decision making across the organization.
Design and implement a robust data platform architecture on AWS, leveraging open-source technologies whenever possible.
Evaluate and select appropriate open-source tools and services for data ingestion, transformation, storage, and analytics.
Develop and maintain data pipelines for efficient movement and processing of large datasets.
Ensure data quality and consistency throughout the data lifecycle.
Implement data security best practices to protect sensitive information.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate them into technical requirements.
Automate data platform tasks and processes for improved efficiency and reliability.
Monitor and troubleshoot data platform performance to identify and resolve issues proactively.
Stay up-to-date on the latest trends and technologies in the data engineering space.
Document data platform design, architecture, and processes for future reference.
Yêu cầu công việc
Yêu cầu công việc
Proven experience (4+ years) as a Senior Data Engineer or similar role.
Strong understanding of data engineering principles and best practices.
Expertise in designing and building scalable data pipelines.
Proficient in working with open-source data technologies (e.g., Apache Spark, Apache Airflow, Kafka, etc.).
Experience with cloud platforms, preferably AWS.
Solid knowledge of SQL and experience with relational databases.
Excellent written and verbal communication skills.
Ability to work independently and as part of a cross-functional team.
Bonus Points
Experience with machine learning and data science workflows.
Experience with data governance and data security frameworks.
Experience with DevOps principles and practices.
Experience building data platforms for similar industries.
Proven experience (4+ years) as a Senior Data Engineer or similar role.
Strong understanding of data engineering principles and best practices.
Expertise in designing and building scalable data pipelines.
Proficient in working with open-source data technologies (e.g., Apache Spark, Apache Airflow, Kafka, etc.).
Experience with cloud platforms, preferably AWS.
Solid knowledge of SQL and experience with relational databases.
Excellent written and verbal communication skills.
Ability to work independently and as part of a cross-functional team.
Bonus Points
Experience with machine learning and data science workflows.
Experience with data governance and data security frameworks.
Experience with DevOps principles and practices.
Experience building data platforms for similar industries.
Thông tin khác
Yêu cầu kỹ thuật:
AWS
,
Apache Kafka
,
Apache Airflow
,
MS SQL
,
Apache Spark
AWS
,
Apache Kafka
,
Apache Airflow
,
MS SQL
,
Apache Spark
Nộp hồ sơ liên hệ
Công ty TNHH Got It
Giới thiệu công ty
Công ty TNHH Got It việc làm
12FL, HCMCC Building, 249A Thuỵ Khuê, Tây Hồ, Hà Nội
Quy mô: Từ 10 - 25 nhân viên
Việc làm tương tự
Data Management (Hà nội)
Công Ty Cổ Phần Thời Trang Yody - Chi Nhánh Hải Dương
Cạnh tranh
Hà Nội
31/07/2024
Kỹ Sư Khoa Học Dữ Liệu (Data Scientist)
Tổng Công ty Mạng lưới Viettel - Chi nhánh Tập đoàn Công nghiệp - Viễn thông Quân đội
25 - 50 triệu VNĐ
Hà Nội
28/07/2024
Senior Data Analysis & Data Science
NGÂN HÀNG TMCP ĐẠI CHÚNG VIỆT NAM - PVcomBank
Cạnh tranh
Hà Nội
30/06/2024
Senior Data Analyst
CÔNG TY TNHH CÔNG NGHỆ VÀ GIẢI PHÁP PHẦN MỀM CROSSIAN
Thoả thuận
Hà Nội
31/07/2024
Vị trí Senior Data Engineer do công ty Công ty TNHH Got It tuyển dụng tại Hà Nội, Joboko tự động tổng hợp mức lương Thỏa Thuận, tìm thêm việc làm về Senior Data Engineer hoặc công ty Công ty TNHH Got It ở các link phía trên
Giới thiệu công ty
Công ty TNHH Got It việc làm
12FL, HCMCC Building, 249A Thuỵ Khuê, Tây Hồ, Hà Nội
Quy mô: Từ 10 - 25 nhân viên