tuyển dụng data Engineer (hadoop/spark) tại hồ chí minh - home credit vietnam

Objective
Serve as a trustworthy partner for Risk Modelling team providing ecosystem and data to enable faster model development, deployment and innovation delivery
Support implementing strategy to reduce dependence on DWH Analytical Playgrounds by migrating to Data Marts and Hadoop as core data platform
Develop and maintaining data pipelines in order to prepare well-structured data for analytic & reporting activities of business users and the needs of the company
The Data & Feature Engineer&039;s main objective is to drive data availability for
business analytic & reporting purposes. Key areas of responsibility:
Develop, maintain and monitor data pipelines preparing suitable data for analytic & reporting activities
Drive utilization of Big Data Hadoop platform to reduce dependence on DWH Analytical Playgrounds
Set up effective data quality monitoring to detect and remedy discrepancies (collaborate with HQ teams)
Analyze data from data producers and transform them into unified form, organize them within the data platforms and/or analytical/production feature store, produce base & derived features in line with Risk Modelling team requirements
Support implementation of Feature Store solution aiming to significantly
transform data preparation, model development, deployment and
monitoring
Build local expertise for end-to-end development, deployment and monitoring of ML models using Feature Store solution
Deliver data processing mechanisms for real-time data processing and analytical use to utilize the value of new technologies
Experience and expertise
Need-to-have areas
Experience as a Data Engineer
Able to communicate in English
Programming Language: SQL and Python on intermediate level
Experience with Big Data ecosystem, data integration, transformation, processing and visualization tools (Hadoop, Hive, Spark, Kafka, NiFi, Airflow, Jupyter) is a big plus
University degree in Computer Science, Engineering or related field is preferred
Good written and oral communication skills
Nice-to-have areas
Able to communicate efficiently as well as to interpret and promote a big data culture to the organization
Experience from working in the data-related area in online, fin-tech, e-commerce, digital, IT dev
Experience with ML Ops is advantage
Experience with PowerBI/Tableau BI tools
Personal characteristics
Ability to formulate, explain, discuss and negotiate topics with IT and Business teams
Good analytical and problem-solving skills
Real passion for data, new data technologies, and discovering new and interesting solutions to the company's data needs
Ability to critically review and identify potential data discrepancies
Ability to work on own initiative and to tight deadlines, resilient to pressure