DataOps Engineer Database, MySQL, SQL
TNHH Công Nghệ MCM
- Chi tiết công việc
- Giới thiệu công ty
Vị trí công việc này hiện tại đã hết hạn nộp hồ sơ, bạn có thể tham khảo thêm một số công việc liên quan phía dưới
Mô tả công việc
The Job
We are looking for an experienced DataOps Engineer to join our team.
The DataOps Engineer is responsible for day-to-day technical development and delivery of data pipelines into StorAI data. You will ensure delivery of solutions based on the backbone of good architecture, best data engineering practises around operational efficiencies, security, reliability, performance and cost optimisation.
To be successful in this role, you have to be an experienced DataOps Engineer with demonstrated knowledge and experience within data delivery, ETL/ELT, data management, solution design and delivery. Critical to success will be strong communication skills, analytical mindset, excellent documentation skills and have demonstrable experience in working with a variety of business stakeholders.
Core Responsibilities
- Develop ETL/ELT solutions using Azure Bob Storage, Data Factory), Spark, and Python to load data across multiple sources into Azure Snowflake.
- Design, implement and maintain a robust, efficient and compliant data pipeline architecture.
- Create and maintain documentation on data pipelines
- Support various components of the data pipelines, including ingestion, validation, cleansing and curation.
- Manage and ensure the success of ongoing data pipeline routines.
- Help the team to maintain an overall position of strong data governance with great data observability (data monitoring & alerting, CI/CD pipelines).
- Build the infrastructure required for optimal acquisition, transformation, and provisioning of data from a variety of data sources.
- Design enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories, and models for structured/unstructured data.
- Engage with our software engineering team to ensure precise data points per application specifications
- Work with customer service, devops, and quality assurance teams to move software through the pipeline to the customer
Your Skills and Experience
- Bachelor's or master's degree in computer science, information systems, engineering, or equivalent
- Experience with relational SQL and NoSQL databases, including Postgres and MSSQL Server.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience working within hybrid cloud environment; Azure experience is a plus
- Expertise with ETL/ELT and the development of automated validation and data pipelines
- Experience with object-oriented/object function scripting languages: .Net Core, C#, Python, Scala,etc
- Expert Understanding of CI/CD and DevOps methodologies
- Experience with Linux, Docker and Bash scripting.
- Experience with basics of search engines/indexing (e.g. Elasticsearch, Lucene)
- Experience with common distributed data tools in a production setting (Spark, Kafka, etc)
- Ability to work on high performing teams supporting multiple projects and personnel.
- Good English verbal communication is a big plus.
Why You'll Love Working Here
Salary & Allowances
- Competitive income with 13th month salary and attractive performance bonus.
- Annual leave: 12 days/year and other leaves/public holidays in accordance with the Labor Law of Vietnam
- Periodic medical checkup, Health/Social Insurances. Especially, Bao Viet Insurance after 10 months of employment
- Be provided with high performance laptop and screen
Career Growth
- Opportunity to experience a great workplace where young & world-class talents work together passionately
- Very diverse offline and online seminars & workshop provided by company, supervisors, mentors and buddies
- Clear and flexible career path
Working Environment
- Working in a progressive and international environment.
- Complimentary snacks, fruits, drinks everyday.
- Team building, company trip and monthly internal events.
Yêu cầu
Quyền lợi
Salary & Allowances
- Competitive income with 13th month salary and attractive performance bonus.
- Annual leave: 12 days/year and other leaves/public holidays in accordance with the Labor Law of Vietnam
- Periodic medical checkup, Health/Social Insurances. Especially, Bao Viet Insurance after 10 months of employment
- Be provided with high performance laptop and screen
Career Growth
- Opportunity to experience a great workplace where young & world-class talents work together passionately
- Very diverse offline and online seminars & workshop provided by company, supervisors, mentors and buddies
- Clear and flexible career path
Working Environment
- Working in a progressive and international environment.
- Complimentary snacks, fruits, drinks everyday.
- Team building, company trip and monthly internal events.
Thông tin khác
MySQL
SQL
Sign in to view
97/7 Lê Quang Định, Ward 14, Binh Thanh, Ho Chi Minh
See map
At office
47 minutes ago
Thông tin chung
- Ngày hết hạn: 25/07/2023
- Thu nhập: You'll love it
Việc làm tương tự
Giải thưởng
của chúng tôi
Top 3
Nền tảng số tiêu biểu của Bộ
TT&TT 2022.
Top 15
Startup Việt xuất sắc 2019 do VNExpress tổ chức.
Top 10
Doanh nghiệp khởi nghiệp sáng tạo Việt Nam - Hội đồng tư vấn kinh doanh ASEAN bình chọn.
Giải Đồng
Sản phẩm công nghệ số Make In Viet Nam 2023.