Senior Data Engineer Python, Java, SQL

We are looking for versatile and experienced Senior Data Engineers to join our team. In this role, you will be responsible for design, development, and maintenance of our data infrastructure for the entire of data lifecycle. You will ensure data is ingested, processed, and made available in a reliable and efficient manner. You will work closely with our product team to understand requirements and deliver robust solutions. The ideal candidate will have a strong foundation in data and expertise in at least two programming languages such as Python, Scala, Java, or AI integration.

Your tasks:

• Interact with business stakeholders and/or customers to understand requirements and to ensure workflows that support business processes in the best possible way.
• Design, develop, and maintain robust and scalable data pipelines and architectures to support various data-driven applications and analytics.
• Develop, maintain, and optimize ETL processes using tools (such as AWS Glue, Apache NiFi, Airflow, etc.) or data exchange platforms (such as flatfile or dromo) to ingest, clean, and transform data from various sources (CSV, excel, pdf, etc.).
• Ensure data quality and consistency through validation and transformation.
• Ensure data integrity and consistency by implementing data normalization, robust data validation and error handling mechanisms.
• Monitor and optimize data pipeline for performance and reliability.
• Optimize data models for transaction processing, reporting, and analytics.
• Ensure data security and compliance with relevant regulations and standards.
• Implement data encryption and access controls.
• Automate data pipeline processes using CI/CD practices and tools.
• Collaborate with cross-functional teams to troubleshoot and resolve data-related or technical issues.
• Stay updated on emerging technologies and recommend innovative solutions to technical challenges.
• Provide technical guidance and support as needed.
• Develop and maintain documentation for data processes, systems, and pipelines.
• Perform other tasks assigned by the team.

MUST HAVE:

• Bachelor's degree in computer science, Engineering, or a related field.
• 4+ years of experience in software development, and 3+ years of experience in data engineering or related field.
• Proficiency in programming languages such as Python, or Scala, or Java, or a similar language.
• Proficiency in SQL and experience with relational database (Postgres, MySQL), and NoSQL.
• Experience with ETL tools/frameworks like AWS Glue, Apache NiFi, Airflow, etc. and processes.
• Familiarity with data warehousing solutions like Redshift, BigQuery, or Snowflake.
• Experience with data modeling and data architecture design.
• Experience with big data technologies (e.g. Hadoop, Spark, Kafka, or Flink).
• Solid understanding of data modeling, data architecture, and data governance principles.
• Good at English skills both in writing & verbally with the ability to work effectively in a team environment.
• Strong problem-solving skills and attention to detail.
• Ability to thrive in a fast-paced, dynamic environment, with a focus on innovation and continuous improvement.
• You are looking for a long-term position in a new young team.
• Can do attitude.

NICE TO HAVE:

• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) is a plus.
• Familiar with data visualization tools (e.g. Power BI, Tableau, etc.) is a plus.
• Experience with CI/CD practices and tools is a plus.
• Willingness for continuous learning and personal development.
• Ability to identify with a product for the logistics sector.
• Enthusiasm, dedication to work and willingness to work in a new team and on a new product with big market potential.
• You have a high sense of discipline and a serious attitude at work.
• Diligent, honest, thorough, agile, inquisitive, hardworking.
• Strong hands-on mentality.

Language skills:

• Written and spoken English
• German communication would be a plus.

• Social security systems such as health insurance, social security, unemployment insurance according to the Labour Code (based on your full gross salary).
• Health Check-Up
• Team Building / Excursions
• Annual salary review
• Opportunity to build an innovative product with disruption potential based on 20 years of domain experience and large amounts of data - strong backing by a well-established German company and highly dynamic team behind.
• Professional, enthusiastic, dynamic environment with learning opportunities in a new location with long-term commitment.
• You will have the opportunity to contribute your own strengths to a new young team and help build up the location.
• 13th salary included, with additional performance bonuses based on individual performance and the company's revenue.
• MacBook M3 pro and all other Apple devices (mouse, keyboard), headset provided by company.