Data Engineer

Data Engineer
Thỏa thuận
Carousell Group is the leading online classifieds marketplace for secondhand goods in Southeast Asia, with a mission to inspire the world to sell and buy more sustainably. Chotot Data Engineering is a sub-team of Carousell Group Data Engineering, focused on building a self-service data infrastructure platform. Our team is dedicated to creating a robust platform that allows users to easily ingest, access, and transform data into valuable insights using familiar and comfortable tools. We are currently seeking a excellent Data Engineer to join our team, you will have the opportunity to work on group level projects that deliver meaningful value and contribute to our missions in Southeast Asia
Trách nhiệm công việc:
Develop and maintain analytics, customer data (CDP) as well as experimentation platform to support business needs and enable data-driven decision making
Design solutions and build self-serve data infrastructure platforms for internal data users such as data ingestion, transformation, streaming processing. The goal is to improve the efficiency and effectiveness of using data across the group through self-service capabilities
Manage common data infrastructures components, such as orchestration tool, logging and monitoring, CI/CD, data governance
Responsible for Cloud cost control via cloud Finops best practices
Build, maintain and efficiently scale complex data ETL, high-throughput real-time and offline data pipeline
Kỹ năng & Chuyên môn:
Must to have:
3+ years of experience in data engineering roles with BSc or MSc degree in Computer Science
Experience building platforms for internal use, with a strong focus on self-service capabilities and efficient data processing
Familiarity with SQL/BigQuery, Kafka, Google Dataflow/Apache Beam, Terraform, Kubernetes, Docker
Strong proficiency in at least one of the following programming languages: Python, Scala
Have experience using the Flask framework
Excellent written and spoken English skills
Ability to quickly learn and adapt to new technologies.
Strong attention to detail, self-motivated, and responsible.
Nice-to-Have:
Experience with Golang
Strong scripting ability in Bash
Familiarity with designing and operating robust distributed systems
Experience with MLOps is a big plus