data Engineer (python, golang, linux, cloud, agile)

Flywheel Digital

Địa điểm làm việc: Hồ Chí Minh

Hết hạn: 11/05/2024

Chi tiết công việc
Giới thiệu công ty

Mức lương: Thỏa thuận

Loại hình: Toàn thời gian

Chức vụ: Nhân viên

golang linux cloud agile

Mô tả công việc

Design, and develop crawler system, data pipelines, data governance compliance, procedures, and tooling to scrape Login required & Open API from e-commerce websites.
Take the initiative to bypass obstacles from anti-crawling system/captcha for platforms
Own the creation and maintenance processes of these tools, services, and workflows to improve crawl/scrape analysis, reports, and data management.
Test the data from API and the scraping to ensure accuracy and quality
Work closely with the team leader and follow the guidelines to accomplish assigned tasks

Yêu cầu công việc

Background in Information Technology, Software Engineering, Data Science
Strong in Crawler, Backend, Linux
Having knowledge and passion for reverse engine is an advantage
Experience running large-scale web scrapes
Familiarity with techniques and tools for crawling, extracting and processing data
3-5 years of hands-on experience of writing code, scripts and APIs (Python, Golang)
Familiarity with Linux, HTTP, HTML, Javascript and Networking
Experience with serverless compute components, BigQuery, Cloud Functions, Cloud Storage, Clickhouse
Experience with system monitoring/administration tools
Proficient understanding of code versioning tools, such as Git
Experience following Agile methodology
Ability to dive into technical details and design analytics solutions to meet business needs
Strong understanding of data flow and system integrations
Good verbal, and written communication skills in English
Experience or understanding marketing/ eCommerce (metrics) is a plus
Diligence, hard work, carefulness and communication skills with the team are required.

Quyền lợi được hưởng

What we offer (Why us)
Competitive salary package with ample opportunities for professional growth.
2 performance review times per year
Up to 15 days off per year
Annual Health check-up, Premium Healthcare Insurance
Social, Health, and Unemployment Insurance will be based on full salary.
Team building monthly, company trip every year, 13th Salary
On-the-job training and coaching with smart and friendly experts
Union and other activities every month (8/3, 20/10, Mid-Autumn, Year-End Party, v.v...)
Free tea, coffee, snacks for member every day
Free Parking fee every month.
Super vibrant startup environment with a talented and very motivated team.
Opportunity to learn from smart managers with vast experience in e-commerce, product development, data management, and technical engineering
Make a great impact for millions of e-commerce businesses.