data Engineer nosql, python, azure

ABOUT THE COMPANY

• The House of Norway was established in 2007 and is a Norwegian company based in Ho Chi Minh City, Vietnam.
• We manage around 80 employees across a variety of software development teams for prestigious companies in Norway such as Upheads AS, Onix AS, Wellbarrier AS, and many more.
• Our core concept is to set up/manage different software teams for global clients and our managers are therefore highly skilled with many years of experience in both the Norwegian and Vietnamese markets.
• As we spend 1/3rd of our waking time working, it is obvious that both consent and happiness in the office are factors that are exceptionally important to us, which is the reason why we believe in having a positive and open-minded culture across the whole the company.
• We focus on teamwork/cooperation and a great deal of humor! • Competitive salary and benefits for our employees are clearly a given, but above that, you will find a company environment where everyone CARE for each other.
• To you, this will be a workplace where you will come to love your colleagues, the culture and be part of an environment where people are open to listen and solve challenges with you, and most of all WE WILL CARE ABOUT YOU.

ABOUT THE JOB

Job Description

• As a data engineer for OceanSMART you will be working on building / maintaining data pipelines, acquiring data from our external suppliers, capturing both real-time data and static data. Making this data available to our development teams for being exposed through our Software as a Service solution.
• Our real-time and batch processing pipelines process a daily load of over 200 million messages and derive insights from billions of historical records.

We are looking for a person who will

• Design and maintain reliable, scalable, efficient data processing pipelines to process real-time data using Event driven approaches.
• Design, develop and maintain highly scalable Kafka Stream processing microservices using Java and Quarkus framework and deploy in Kubernetes
• Use Apache Spark to process historical data (billions of records and terabytes in size) using Scala/Python and derive optimizations & insights
• Responsible for data modelling in RDBMS, NoSQL data stores like HBase/Mongo DB and Archive datastores on Azure Blobs or ADLS Gen2 datastores
• Monitoring/Alerting
• Identify opportunities and explore ways to enhance data infrastructure to improve data acquisition, data processing, and data visualization processes
• Collaborate with DevOps for data pipeline setup and configuration

Personal Traits

• Being open-minded and curious
• Speak up when solutions are not ideal and communicate suggested solutions to cross-functional pairs.
• Ability to work independently because you are the first brick of the team, many opportunities but also many challenges.
• A true team player with great communication and interpersonal skills.

A potential candidate will have

Required Experience:

• Bachelor's or master's degree in computer science, Software Engineering, Information Technology, or a related technical field.
• 3+ years' experience as a Data Engineer or similar role.
• Understand the big picture
• Experience with big-data technologies such as Apache Kafka and Apache Spark.
• Experience with JVM languages (Java or Scala), Python.
• Good at multi-threading, atomic operations
• Computation framework: Spark (Azure Batch & Databricks)
• Databases:
• SQL: Postgres (Postgis), SQL server, TimescaleDB
• NoSQL: Hbase, Cassandra, MongoDB
• Object data stores: Azure Blob Store, different storage tiers
• Mapping: Geoserver
• Understand designs of resilience, fault-tolerance, high availability, and high scalability

Desirable

• Hand-on experiences on popular Data platforms such as Azure, Amazon or GCP with event driven, micro-service architecture for loosely coupled, highly scalable design.
• Experience in performance tuning/optimizing Big Data programs. • Familiar with Scrum framework, Scrum with Kanban

Attractive Benefits:

• Great salary package. Annual performance review.
• 13th-salary Bonus for all staff.
• 14th-salary Bonus for those who have worked for more than 5 years.
• Premium Healthcare Insurance Package and Annual Health Check-up for all staff.
• Loyalty Employee Benefit: all staff who have worked for more than 1.5 years will receive a package (VND 3mil, VND 5mil, VND 10mil) EVERY year to go on a vacation, have a luxury meal, or enjoy a fancy service with family and friends.
• Sponsor and encourage staff to study courses by covering tuition fee and examination fee, and give out a bonus for the certificate the staff gets.
• Good career advancement opportunities.
• Product-oriented. Agile project management style. Dynamic and English-speaking working environment.
• Opportunity to acquire technical knowledge and experience in the latest technologies.
• Opportunity to go work on-site.
• At least 17 annual leaves.
• Company trip, Year-End Party.
• Friday Party, Salary Day Celebration, Teambuilding outdoor activities.
• Free coffee (cappuccino, cafe latte, latte macchiato, etc), milk and juice. Kitchen and Library at work. Billards and darts are equipped for your enjoyments and convenience.
• Working hours: 8 hours x 5 days/week (Monday to Friday). Thirty-min break at 4 PM every day.
• Free language training: English (company-sponsored).