- Chi tiết công việc
- Giới thiệu công ty
Mức lương: Thoả thuận
Loại hình: Toàn thời gian
Kinh nghiệm: 4 năm
Mô tả công việc
Design, build, maintain scalable and implement efficient data pipelines and solutions for data-driven projects in Azure Data Factory and Azure Databricks (using PySpark and Databricks), data pipelines;
Optimize data processing and storage for maximum performance and efficiency;
Troubleshoot and debug data-related issues, and implement solutions to prevent reoccurrence;
Collaborate with data scientists, software engineers, and other stakeholders to ensure that data solutions are aligned with business goals.
Optimize data processing and storage for maximum performance and efficiency;
Troubleshoot and debug data-related issues, and implement solutions to prevent reoccurrence;
Collaborate with data scientists, software engineers, and other stakeholders to ensure that data solutions are aligned with business goals.
Yêu cầu công việc
Minimum of 4 years of experience as a Data Engineer;
Strong experience in Python programming and PySpark, Databricks and SparkSQL;
Clear understanding of Spark Data structures, RDD, Dataframe, dataset;
Expertise handling data type, from dictionaries, lists, tuples, sets, arrays, pandas dataframes, and spark dataframes;
Expertise working with complex data types such as structs and JSON strings;
Clear understanding of Spark Broadcast, Repartition, Bloom index filters;
Experience with ADLS optimization, partitioning, shuffling and shrinking;
Ideal experience with disk caching and cost-based optimizer;
Experience with data modeling, data warehousing, data-lake, delta-lake and ETL/ELT processes in ADF;
Strong analytical and problem-solving skills;
Good at English.
Strong experience in Python programming and PySpark, Databricks and SparkSQL;
Clear understanding of Spark Data structures, RDD, Dataframe, dataset;
Expertise handling data type, from dictionaries, lists, tuples, sets, arrays, pandas dataframes, and spark dataframes;
Expertise working with complex data types such as structs and JSON strings;
Clear understanding of Spark Broadcast, Repartition, Bloom index filters;
Experience with ADLS optimization, partitioning, shuffling and shrinking;
Ideal experience with disk caching and cost-based optimizer;
Experience with data modeling, data warehousing, data-lake, delta-lake and ETL/ELT processes in ADF;
Strong analytical and problem-solving skills;
Good at English.
Quyền lợi được hưởng
Work in Agile teams, enjoy good teamwork, and work in a professional working environment;
Possibility to develop your career within an international company;
We are a global company, with many offices and projects all over the world (opportunity to travel to other countries where there are Pentalog offices);
We provide a professional roadmap, support, and onboard training;
Free technical learning courses, foreign language courses (English, French);
Enjoy interesting activities: Coding challenges, PentaBAR, Hackathon etc.;
100% of the salary is paid during the probation period;
Attractive salary and bonuses;
Social insurance payment is based on the full salary to keep your full benefits;
A premium healthcare package (PVI 24/7 health insurance package + an annual health check-up);
Flexible working hours, no fingerprint timekeeping;
Working days: 5 days/week: from Monday to Friday (we don't encourage working overtime, as we value our colleague's personal time);
Paid annual leave: 26 days (11 holidays +15 vacation days);
Company equipment: devices and subscriptions used for work (Laptop, Case, Smartphone etc.);
Enjoy bonding activities like team building, summer holiday, Christmas party, Happy hour etc.
Possibility to develop your career within an international company;
We are a global company, with many offices and projects all over the world (opportunity to travel to other countries where there are Pentalog offices);
We provide a professional roadmap, support, and onboard training;
Free technical learning courses, foreign language courses (English, French);
Enjoy interesting activities: Coding challenges, PentaBAR, Hackathon etc.;
100% of the salary is paid during the probation period;
Attractive salary and bonuses;
Social insurance payment is based on the full salary to keep your full benefits;
A premium healthcare package (PVI 24/7 health insurance package + an annual health check-up);
Flexible working hours, no fingerprint timekeeping;
Working days: 5 days/week: from Monday to Friday (we don't encourage working overtime, as we value our colleague's personal time);
Paid annual leave: 26 days (11 holidays +15 vacation days);
Company equipment: devices and subscriptions used for work (Laptop, Case, Smartphone etc.);
Enjoy bonding activities like team building, summer holiday, Christmas party, Happy hour etc.
Thông tin khác
Cấp bậc
Nhân viên
Kinh nghiệm
4 năm
Số lượng tuyển
8 người
Hình thức làm việc
Toàn thời gian
Giới tính
Không yêu cầu
Nhân viên
Kinh nghiệm
4 năm
Số lượng tuyển
8 người
Hình thức làm việc
Toàn thời gian
Giới tính
Không yêu cầu
Nộp hồ sơ liên hệ
Công ty TNHH Pentalog Việt Nam
Giới thiệu công ty
Xem trang công ty
Pentalog là một tập đoàn hàng đầu của Pháp về dịch vụ tin học và gia công phần mềm. Được thành lập từ năm 1993, tập đoàn hiện có khoảng 750 nhân viên và đặt chi nhánh tại 6 quốc gia trên thế giới là Pháp, Đức, Ru-ma-ni, Môn-đô-va, Israel và Việt Nam. Pentalog Việt Nam được thành lập từ đầu năm...
Quy mô công ty
Từ 26 - 100 nhân viên
Việc làm tương tự
Công Ty TNHH Hệ Thống Thông Tin FPT - FPT Information System
Thoả thuận
03/06/2024
Hà Nội
Công ty TNHH Sản xuất và Thương mại CMC
Thoả thuận
03/06/2024
Hà Nội, Hồ Chí Minh
Công ty Cổ phần Phát triển Công nghệ Viễn thông Tin học Sun Việt
Thỏa thuận
29/05/2024
Hà Nội
hỗ trợ doanh nghiệp
Giải thưởng
của chúng tôi
Top 3
Nền tảng số tiêu biểu của Bộ
TT&TT 2022.
Top 15
Startup Việt xuất sắc 2019 do VNExpress tổ chức.
Top 10
Doanh nghiệp khởi nghiệp sáng tạo Việt Nam - Hội đồng tư vấn kinh doanh ASEAN bình chọn.
Giải Đồng
Sản phẩm công nghệ số Make In Viet Nam 2023.