Data Integration Engineer - Team Lead (Python, Pentaho, other ETL tools)B2B Commerce (M) Sdn Bhd.

The role of Data Integration Team Lead is to design, develop and maintain our integration platform to cater for batch data movement as well as point-to-point operational integration.

You will be expected to manage integration implementation from various data source to connect them to our in-house web application, data warehouse as well third-party application.

• Develop and document technical specification for system integration and testing activities.


• Review the entire architecture end to end and be responsible for design, development and maintenance of the data integration hub


• Design and develop frameworks that the team will adhere to.


• Analyse the requirements of the client and design the best method to handle.


• Support the development of appropriate integration and testing strategies.


• Develop the defined integration activities.


• Execute the tests and manage the test results and associated data.


• Support the production of test reports and associated test conclusions.


• Support the status reporting of integration and test activities.


• Support the continuous improvement of integration and testing processes, procedures and tools.

• Bachelor's degree in computer science or a related field or the equivalent demonstrated experience


• Possess a minimum of 7-9 years' working experience in system integration and testing.


• 2-3 years' experience in Pentaho Data Integration (PDI) ETL or other ETL tools


• Experience in Python for data integration


• Experience managing large numbers of integration flows


• Strong knowledge and understanding of integration connectivity (API, AS1/2/3, S/FTP/S, REST API, WS, SMTP)


• Experience with techniques and tools for crawling, extracting, and processing data.


• Data leader with a strong understanding of the enabling technologies


• Demonstrated experience in operating strong data governance programs


• Ability to engage effectively with business and technical teams


• English speaking