Senior Data Engineer (big data, hadoop, nosql)
Capgemini VietnamĐịa điểm làm việc: Hồ Chí Minh
Hết hạn: 22/06/2023
- Chi tiết công việc
- Giới thiệu công ty
Vị trí công việc này hiện tại đã hết hạn nộp hồ sơ, bạn có thể tham khảo thêm một số công việc tương tự tại đây:
Mô tả công việc
Mô tả công việc
Tóm tắt công việc
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
Develop and maintain data pipelines using ETL processes.
Work closely with data science team to implement data analytics pipelines.
Maintain security and data privacy, working closely with data protection officer.
Implement scalable architectural models for data processing and storage.
Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode.
Help in scoping, estimation, and planning to for various projects in the enterprise.
Provide technical support to project teams as needed.
Competitive salary, health insurance covered for employee and dependents
Working on international projects. Professional and dynamic working environment
Achieving valuable experience with variety projects, new technologies and hundreds of talents
Receiving training opportunities including many technical seminars and soft skill training courses
Good opportunity for promotion through regular performance review system
Hybrid work
Tóm tắt công việc
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
Develop and maintain data pipelines using ETL processes.
Work closely with data science team to implement data analytics pipelines.
Maintain security and data privacy, working closely with data protection officer.
Implement scalable architectural models for data processing and storage.
Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode.
Help in scoping, estimation, and planning to for various projects in the enterprise.
Provide technical support to project teams as needed.
Competitive salary, health insurance covered for employee and dependents
Working on international projects. Professional and dynamic working environment
Achieving valuable experience with variety projects, new technologies and hundreds of talents
Receiving training opportunities including many technical seminars and soft skill training courses
Good opportunity for promotion through regular performance review system
Hybrid work
Yêu cầu công việc
Yêu cầu công việc
Must have Technical Requirements / Qualifications
B.S. in Computer Science, related fields or commensurate work experience.
5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig... and ETL with large amounts of data.
Experience on complex regulatory data integration projects.
Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
Agile based delivery knowledge
Excellent English communication - verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
Strong teambuilding skills and teamwork orientation.
Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
AZ-900: Microsoft Azure Fundamentals.
Azure Data Engineer - Associate.
Must have Technical Requirements / Qualifications
B.S. in Computer Science, related fields or commensurate work experience.
5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig... and ETL with large amounts of data.
Experience on complex regulatory data integration projects.
Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
Agile based delivery knowledge
Excellent English communication - verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
Strong teambuilding skills and teamwork orientation.
Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
AZ-900: Microsoft Azure Fundamentals.
Azure Data Engineer - Associate.
Thông tin khác
Yêu cầu kỹ thuật:
Python
,
MS SQL
,
Hadoop
,
Oracle
,
Unix
,
MongoDB
,
ETL
,
NoSQL
,
SOLID
,
HDFS
,
Apache Spark
,
Apache Hive
,
Scala
,
MS Azure
,
SAS
,
Teradata
,
Apache Kafka
,
Tableau
,
AWS
,
Data Warehouse
,
Performance tuning
,
Informatica
,
GCP
,
IBM
,
Azure Data Lake
,
Azure Data Factory
,
Azure Databricks
,
Databricks
,
Delta Lake
Python
,
MS SQL
,
Hadoop
,
Oracle
,
Unix
,
MongoDB
,
ETL
,
NoSQL
,
SOLID
,
HDFS
,
Apache Spark
,
Apache Hive
,
Scala
,
MS Azure
,
SAS
,
Teradata
,
Apache Kafka
,
Tableau
,
AWS
,
Data Warehouse
,
Performance tuning
,
Informatica
,
GCP
,
IBM
,
Azure Data Lake
,
Azure Data Factory
,
Azure Databricks
,
Databricks
,
Delta Lake
Nộp hồ sơ liên hệ
Capgemini Vietnam
Giới thiệu công ty
Xem trang công ty
Capgemini is a multicultural company of 300,000 people in nearly 50 countries, who work with world-renowned clients to find solutions to their most demanding challenges. As a global leader in consulting, digital transformation, technology and engineering services - with unrivaled sectorial expertise - we enable our clients to design and build tomorrow's businesses, make the most of the opportunities offered by technology, and boost their competitiveness and agility.
Quy mô công ty
Từ 101 - 500 nhân viên
Việc làm tương tự
Công ty Cổ phần Hỗ trợ Dịch vụ Thanh toán Việt Phú
Thoả thuận
19/05/2024
Hồ Chí Minh
Công ty Cổ phần Chứng khoán Vietcap
Thỏa thuận
19/05/2024
Hồ Chí Minh
CÔNG TY CỔ PHẦN GREENFEED VIỆT NAM
Cạnh tranh
09/05/2024
Hồ Chí Minh
Công ty Cổ phần Hỗ trợ Dịch vụ Thanh toán Việt Phú
Cạnh tranh
31/05/2024
Hồ Chí Minh
Ngân hàng TMCP Phát triển TP.HCM - HD Bank
Thỏa thuận
30/04/2024
Hồ Chí Minh
hỗ trợ doanh nghiệp
Giải thưởng
của chúng tôi
Top 3
Nền tảng số tiêu biểu của Bộ
TT&TT 2022.
Top 15
Startup Việt xuất sắc 2019 do VNExpress tổ chức.
Top 10
Doanh nghiệp khởi nghiệp sáng tạo Việt Nam - Hội đồng tư vấn kinh doanh ASEAN bình chọn.
Giải Đồng
Sản phẩm công nghệ số Make In Viet Nam 2023.