Senior/Leader Data Engineer Database, MySQL, SQLTNHH Công Nghệ MCM
Hình thức: Toàn thời gian
Ngày đăng: 13/06/2024
Hạn nộp: 18/08/2024
Mô tả công việc
We are looking for a Senior/Leader DataOps Engineer to join our team.
The Data Engineer is responsible for day-to-day technical development and delivery of data pipelines into StorAI data. You will ensure delivery of solutions based on the backbone of good architecture, best data engineering practises around operational efficiencies, security, reliability, performance and cost optimisation.
To be successful in this role, you have to be an experienced Data Engineer with demonstrated knowledge and experience within data delivery, ETL/ELT, data management, solution design and delivery. Critical to success will be strong communication skills, analytical mindset, excellent documentation skills and have demonstrable experience in working with a variety of business stakeholders.
Core Responsibilities
Develop ETL/ELT solutions using Azure Bob Storage, Data Factory), Spark, and Python to load data across multiple sources into Azure Snowflake.
Design, implement and maintain a robust, efficient and compliant data pipeline architecture.
Create and maintain documentation on data pipelines
Support various components of the data pipelines, including ingestion, validation, cleansing and curation.
Manage and ensure the success of ongoing data pipeline routines.
Help the team to maintain an overall position of strong data governance with great data observability (data monitoring & alerting, CI/CD pipelines).
Build the infrastructure required for optimal acquisition, transformation, and provisioning of data from a variety of data sources.
Design enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories, and models for structured/unstructured data.
Engage with our software engineering team to ensure precise data points per application specifications
Work with customer service, devops, and quality assurance teams to move software through the pipeline to the customer
The Data Engineer is responsible for day-to-day technical development and delivery of data pipelines into StorAI data. You will ensure delivery of solutions based on the backbone of good architecture, best data engineering practises around operational efficiencies, security, reliability, performance and cost optimisation.
To be successful in this role, you have to be an experienced Data Engineer with demonstrated knowledge and experience within data delivery, ETL/ELT, data management, solution design and delivery. Critical to success will be strong communication skills, analytical mindset, excellent documentation skills and have demonstrable experience in working with a variety of business stakeholders.
Core Responsibilities
Develop ETL/ELT solutions using Azure Bob Storage, Data Factory), Spark, and Python to load data across multiple sources into Azure Snowflake.
Design, implement and maintain a robust, efficient and compliant data pipeline architecture.
Create and maintain documentation on data pipelines
Support various components of the data pipelines, including ingestion, validation, cleansing and curation.
Manage and ensure the success of ongoing data pipeline routines.
Help the team to maintain an overall position of strong data governance with great data observability (data monitoring & alerting, CI/CD pipelines).
Build the infrastructure required for optimal acquisition, transformation, and provisioning of data from a variety of data sources.
Design enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories, and models for structured/unstructured data.
Engage with our software engineering team to ensure precise data points per application specifications
Work with customer service, devops, and quality assurance teams to move software through the pipeline to the customer
Yêu cầu công việc
Bachelor's or master's degree in computer science, information systems, engineering, or equivalent
Experience with relational SQL and NoSQL databases, including Postgres and MSSQL Server.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience working within hybrid cloud environment; Azure experience is a plus
Expertise with ETL/ELT and the development of automated validation and data pipelines
Experience with object-oriented/object function scripting languages: .Net Core, C#, Python, Scala,etc
Expert Understanding of CI/CD and DevOps methodologies
Experience with Linux, Docker and Bash scripting.
Experience with basics of search engines/indexing (e.g. Elasticsearch, Lucene)
Experience with common distributed data tools in a production setting (Spark, Kafka, etc)
Experience with the managing team.
Ability to work on high performing teams supporting multiple projects and personnel.
Good English verbal communication.
Experience with relational SQL and NoSQL databases, including Postgres and MSSQL Server.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience working within hybrid cloud environment; Azure experience is a plus
Expertise with ETL/ELT and the development of automated validation and data pipelines
Experience with object-oriented/object function scripting languages: .Net Core, C#, Python, Scala,etc
Expert Understanding of CI/CD and DevOps methodologies
Experience with Linux, Docker and Bash scripting.
Experience with basics of search engines/indexing (e.g. Elasticsearch, Lucene)
Experience with common distributed data tools in a production setting (Spark, Kafka, etc)
Experience with the managing team.
Ability to work on high performing teams supporting multiple projects and personnel.
Good English verbal communication.
Quyền lợi được hưởng
Salary & Allowances
Competitive income with 13th month salary and attractive performance bonus.
Annual leave: 12 days/year and other leaves/public holidays in accordance with the Labor Law of Vietnam
Periodic medical checkup, Health/Social Insurances. Especially, Health Insurance after 10 months of employment
Be provided with high performance laptop and screen
Career Growth
Opportunity to experience a great workplace where young & world-class talents work together passionately
Very diverse offline and online seminars & workshop provided by company, supervisors, mentors and buddies
Clear and flexible career path
Working Environment
Working in a progressive and international environment.
Complimentary snacks, fruits, drinks everyday.
Team building, company trip and monthly internal events.
Competitive income with 13th month salary and attractive performance bonus.
Annual leave: 12 days/year and other leaves/public holidays in accordance with the Labor Law of Vietnam
Periodic medical checkup, Health/Social Insurances. Especially, Health Insurance after 10 months of employment
Be provided with high performance laptop and screen
Career Growth
Opportunity to experience a great workplace where young & world-class talents work together passionately
Very diverse offline and online seminars & workshop provided by company, supervisors, mentors and buddies
Clear and flexible career path
Working Environment
Working in a progressive and international environment.
Complimentary snacks, fruits, drinks everyday.
Team building, company trip and monthly internal events.
Nộp hồ sơ liên hệ
TNHH Công Nghệ MCM
Giới thiệu công ty
TNHH Công Nghệ MCM việc làm
18Bis/13/3 Nguyen Thi Minh Khai Street, Da Kao Ward, 1st District, Ho Chi Minh City Vietnam
Quy mô: Từ 10 - 25 nhân viên
Việc làm tương tự
Junior/Senior Data Engineer (ETL, Python, Azure)
KMS TECHNOLOGY VIETNAM COMPANY LIMITED
Thỏa thuận
Hồ Chí Minh
13/07/2024
Data Engineer Manager (Python, AWS, SQL)
CÔNG TY CỔ PHẦN GREENFEED VIỆT NAM
Thỏa thuận
Hồ Chí Minh
31/07/2024
Data Engineer
CÔNG TY CỔ PHẦN VINHOMES - TẬP ĐOÀN VINGROUP
Thỏa thuận
Hà Nội, Hồ Chí Minh
07/07/2024
Data Engineer - Python & SQL (Junior/Middle)
CÔNG TY TNHH FINAN
Thỏa thuận
Hồ Chí Minh, Điện Biên
13/08/2024
Data Engineer
Công Ty Cổ Phần Thời Trang Yody - Chi Nhánh Hải Dương
Cạnh tranh
Hồ Chí Minh
31/07/2024
Vị trí Senior/Leader Data Engineer Database, MySQL, SQL do công ty TNHH Công Nghệ MCM tuyển dụng tại Hồ Chí Minh, Joboko tự động tổng hợp mức lương Thỏa thuận, tìm thêm việc làm về Senior/Leader Data Engineer Database, MySQL, SQL hoặc công ty TNHH Công Nghệ MCM ở các link phía trên
Giới thiệu công ty
TNHH Công Nghệ MCM việc làm
18Bis/13/3 Nguyen Thi Minh Khai Street, Da Kao Ward, 1st District, Ho Chi Minh City Vietnam
Quy mô: Từ 10 - 25 nhân viên