Junior Data Engineer

ABOUT THE ROLE
Crossian is a high-growth technology-driven e-commerce business. Behind our success is our people. As a start-up formed in 2020, we have created a fast-paced and dynamic environment, enabling our people to reach a cumulative average growth rate of over 400% in just under 3 years. Our mission now is to build direct-to-consumer brands and increase customer LTV.
As a Data Engineer, you are part of Technology Innovations Center of Excellence (CoE), supervised by the Engineering Manager & advised by the CTO. With an Agile mindset working a strong-Tech Startup environment culture (Silicon Valley style Tech-startup), you will check in with project teams daily, collecting information from other products to remain in sync with the entire eco-system.
We are creating a comprehensive Cross-border eCommerce Platform that features solutions for Storefront, Payment Gateway, Inventory, Catalog, Logistics, Marketing Insights, CRM... Here are some examples:
Develop a Storefront solution
Centralize payment gateways for managing transactions and after-payment business (such as refunds, chargebacks, claims, inquiries,..)
Integrate various 3rd services to operate a complete supply-chain system, including inventory, catalogs, logistics tracking, and more...
Convert raw data from marketing campaigns, transactions, user behavior, etc., into insights beneficial and significant for business operations.
Plus, numerous other opportunities await your input.
In addition to development tasks, collaboration with other Centers of Excellence (CoEs) at Crossian is crucial to comprehend issues within their specific sectors. Thus, from a technical standpoint, you will propose solutions to help them improve consistently every day.
WHAT YOU WILL DO
Participate in Requirements Analysis & Technical Specification in the Agile/Scrum development process.
Design, develop, and maintain scalable data pipelines and ETL processes to collect, clean, and process large datasets. The system is built on the microservice architecture and deployed Kubernetes (use AWS EKS service) across 3 AWS regions globally (US, HK, SG).
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop data solutions that meet business needs. Use BI tools for data analytics, such as Grafana, AWS QuickSight, or Excel (Google Sheets).
Develop and implement data integration strategies and data transformation logic, ensuring high-quality and accurate data in the data warehouse. Use Kafka and Nifi tech-stack & eco-system to build data flow.
Optimize and improve the performance, efficiency, and reliability of data pipelines, data models, and data storage solutions. Use database or object storage services like PostgreSQL, ElasticSearch, Redis, and AWS S3.
Monitor and troubleshoot data pipeline issues, ensuring data integrity and timely data delivery. Use tools for monitoring logs and issues such as Sentry, Grafana, or alerts Slack.