Mô tả công việc
Data Pipeline Development
Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data flow and integration.
Work with structured and unstructured data from various sources.
Data Management
Ensure data integrity, accuracy, and consistency across all data systems.
Implement and monitor data quality checks to maintain high standards of data quality.
Collaboration
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Assist in integrating data from different sources into a unified data warehouse.
Performance Optimization
Optimize data processing workflows and database performance.
Identify and resolve data-related issues and bottlenecks.
Documentation
Create and maintain documentation for data pipelines, processes, and data models.
Ensure all data engineering practices comply with company policies and industry standards.
Yêu cầu
- Timework: Hybrid (3 off, 2 on)
- Bachelor's degree in computer science, Engineering, or a related field.
2-4 years of experience in data engineering or a related role.
- Proficiency in programming languages such as Python or Java.
- Strong experience with SQL and relational databases (e.g., MySQL, PostgreSQL, SQL Server).
- Familiarity with big data technologies (e.g., Hadoop, Spark) and data processing frameworks.
- Experience with ETL tools (e.g., Talend, Apache Nifi) and data integration processes.
- Knowledge of cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
- Strong problem-solving skills and attention to detail.
- English communication skills, both written and verbal is a plus point.
Preferred Skills:
Experience with NoSQL databases (e.g., MongoDB, Cassandra).
Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).
Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
Understanding of machine learning and data analytics concepts.
Experience with version control systems (e.g., Git) and CI/CD pipelines.
Certification in cloud data services or big data technologies.
Quyền lợi
- No need to try a job, get an official job with 100% salary
- Opportunities onsite and working with big customers, advanced technology, self-development...
- The opportunity to work in groups with many leading experts in the field of domestic and international IT.
- Opportunity to implement ambitious projects in many countries, exposure to the latest technologies and learn from good colleagues.
- Working in a young, vibrant, modern and multicultural environment; Communication activities and events on holidays take place regularly.
- Opportunity for advancement based on ability with corresponding increase in rank and salary increase.
- Have the right to participate in soft skills training courses (logical thinking, creative thinking, communication skills, project management skills, negotiation skills...) and Japanese language classes.
- And many other attractive benefits...
Thông tin khác
Kinh nghiệm 4 năm
Trình độ Không yêu cầu
Vị trí Middle
Loại công việc
Hình thức Full-time
Hạn nộp hồ sơ 2024-09-22
Số lượng 1 người
Quy trình phỏng vấn 1 vòng