Data Engineer Recruitment

Accountabilities and Outcomes
● Design and implement data pipelines to transform and enrich trading and market data into valuable
assets.
● Design data schemas to enable new products and integrations.
● Use rapid prototyping and user feedback to validate solutions.
● Scale data products and integrate them into larger technology ecosystems.
● Understand data governance and privacy requirements and utilize tools and techniques to meet
compliance requirements.
● Build and monitor validation tooling to ensure security and governance policies do not fail
● Establish and maintain de-identification methodologies and controls to ensure that we use data in a
compliant manner.
● Implement and automate data handling operations for the data lifecycle.
● Continued awareness of best practice data engineering standards that uplift and simplify product
delivery.
● Clearly present findings, methodologies, and recommendations to technical and non-technical
stakeholders.
● As part of a team, participate and collaborate to understand client pain points, analyse solutions, and
continuously improve the products to deliver market leading products with a delightful user
experience.
Core Skills & Knowledge
● Multi-year industry experience developing client-facing data products in a serverless data platform
(AWS or Azure).
● Experience designing and building data lakes and lakehouses using Databricks, Snowflake or
Glue/Spark
● Experience building/operating highly available, distributed systems for extraction, ingestion, and
processing of large data sets.
● Expert in the architecture of data warehousing solutions for the enterprise using cloud technologies.
● Familiarity with multiple common databases such as MySQL, PostgreSQL and AWS DynamoDB.
● Experience consuming data from streaming platforms eg: Apache Kafka.
● Multi-year industry experience with Python and SQL (or equivalent languages).
● Experience in collaborative coding and working in co-located or remote team structures.
● Experience mentoring less-experienced engineers while actively learning and engaging with more
experienced technologists.
● Experience in driving software quality by utilising the test pyramid.
● Has a growth mindset and excitement about tackling the next challenge with a team, understands
that growth comes from continuously developing through hard work
● Degree in Computer Science, Engineering, Mathematics, or a related field or 3+ years industry
experience