Vị trí công việc này hiện tại đã hết hạn nộp hồ sơ, bạn có thể tham khảo thêm một số công việc liên quan phía dưới
Mô tả công việc
Mô tả công việc
Tóm tắt công việc
We are seeking a Senior Data Engineer to play a pivotal role in building our data platform from the ground up. You will be responsible for designing, developing, and deploying a scalable, secure, and open-source based data platform on the AWS cloud. This is a unique opportunity to shape the future of our data infrastructure and empower data-driven decision making across the organization.
Design and implement a robust data platform architecture on AWS, leveraging open-source technologies whenever possible.
Evaluate and select appropriate open-source tools and services for data ingestion, transformation, storage, and analytics.
Develop and maintain data pipelines for efficient movement and processing of large datasets.
Ensure data quality and consistency throughout the data lifecycle.
Implement data security best practices to protect sensitive information.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate them into technical requirements.
Automate data platform tasks and processes for improved efficiency and reliability.
Monitor and troubleshoot data platform performance to identify and resolve issues proactively.
Stay up-to-date on the latest trends and technologies in the data engineering space.
Document data platform design, architecture, and processes for future reference.
Yêu cầu
Yêu cầu công việc
Proven experience (4+ years) as a Senior Data Engineer or similar role.
Strong understanding of data engineering principles and best practices.
Expertise in designing and building scalable data pipelines.
Proficient in working with open-source data technologies (e.g., Apache Spark, Apache Airflow, Kafka, etc.).
Experience with cloud platforms, preferably AWS.
Solid knowledge of SQL and experience with relational databases.
Excellent written and verbal communication skills.
Ability to work independently and as part of a cross-functional team.
Bonus Points
Experience with machine learning and data science workflows.
Experience with data governance and data security frameworks.
Experience with DevOps principles and practices.
Experience building data platforms for similar industries.
Thông tin khác
Yêu cầu kỹ thuật:
AWS
,
Apache Kafka
,
Apache Airflow
,
MS SQL
,
Apache Spark
Thông tin chung
- Ngày hết hạn: 20/06/2024
- Thu nhập: Thỏa Thuận
Got IT is a private consulting company working in digitalization, IT solutions for small and medium sized business across the country. Our portfolios include TeaOlogy - the finest bubble tea chain in Norway, Mama Pho - Authentic Vietnamese restaurant etc. As a small and growing startup company with a young team of doers, we believe in the power of the applying technology and digital transformation into traditional industries such as food and beverage, entertainment, beauty and or retail.
Quy mô công ty
Từ 10 - 25 nhân viên
