- Chi tiết công việc
- Giới thiệu công ty
Thu nhập: Thỏa thuận
Loại hình: Toàn thời gian
Chức vụ: Nhân viên
Kinh nghiệm: 5 năm
Mô tả công việc
We are seeking a highly skilled and experienced Cloud Engineer with expertise in AWS Managed Streaming for Apache Kafka (MSK) to join our engineering team. In this role, you will be responsible for designing, implementing, and managing our event-driven architectures and real-time streaming solutions using AWS MSK. Your work will be pivotal in enabling our systems to process large-scale data streams efficiently, ensuring high availability, scalability, and reliability. Your Responsibilities:AWS MSK Management:
Design, implement, and maintain streaming solutions using AWS Managed Streaming for Apache Kafka (MSK)
Monitor and manage Kafka clusters to ensure optimal performance, scalability, and uptime.
Configure and fine-tune MSK clusters, including partitioning strategies, replication, and retention policies.
Event-Driven Architecture:
Collaborate with our engineering teams to design and implement event-driven systems and microservices architectures.
Develop and maintain robust data pipelines to process and stream data in real-time using Kafka.
Ensure seamless integration between MSK/SQS/SNS and other AWS services such as Lambda, EventBridge Pipes, S3.
Performance Optimization:
Analyze and optimize the performance of Kafka clusters and streaming pipelines to meet high-throughput and low-latency requirements.
Implement best practices for Kafka topic design, consumer group management, and message serialization (e.g., Avro).
Security and Compliance:
Implement security best practices for MSK, including encryption, authentication, and access controls.
Ensure compliance with industry standards and regulations related to data streaming and event processing.
Monitoring and Troubleshooting:
Set up comprehensive monitoring and alerting for Kafka clusters and streaming applications using AWS CloudWatch and Datadog.
Troubleshoot and resolve issues related to data loss, message lag, and streaming failures.
Data Integration and ETL:
Design and implement data integration solutions to stream data between various sources and targets using MSK.
Lead data transformation and enrichment processes to ensure data quality and consistency in streaming applications
Design, implement, and maintain streaming solutions using AWS Managed Streaming for Apache Kafka (MSK)
Monitor and manage Kafka clusters to ensure optimal performance, scalability, and uptime.
Configure and fine-tune MSK clusters, including partitioning strategies, replication, and retention policies.
Event-Driven Architecture:
Collaborate with our engineering teams to design and implement event-driven systems and microservices architectures.
Develop and maintain robust data pipelines to process and stream data in real-time using Kafka.
Ensure seamless integration between MSK/SQS/SNS and other AWS services such as Lambda, EventBridge Pipes, S3.
Performance Optimization:
Analyze and optimize the performance of Kafka clusters and streaming pipelines to meet high-throughput and low-latency requirements.
Implement best practices for Kafka topic design, consumer group management, and message serialization (e.g., Avro).
Security and Compliance:
Implement security best practices for MSK, including encryption, authentication, and access controls.
Ensure compliance with industry standards and regulations related to data streaming and event processing.
Monitoring and Troubleshooting:
Set up comprehensive monitoring and alerting for Kafka clusters and streaming applications using AWS CloudWatch and Datadog.
Troubleshoot and resolve issues related to data loss, message lag, and streaming failures.
Data Integration and ETL:
Design and implement data integration solutions to stream data between various sources and targets using MSK.
Lead data transformation and enrichment processes to ensure data quality and consistency in streaming applications
Yêu cầu
Must have skills:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Minimum of 5 years of experience in event-driven architectures and streaming solutions.
Proven experience with Apache Kafka, with at least 2 years specifically in AWS MSK.
Experience in designing and implementing high-throughput, low-latency streaming applications in AWS environments.
Strong understanding of Kafka internals, including partitions, brokers, consumer groups, and message serialization formats.
Proficiency in programming languages such as Java, Python, or Scala for building streaming applications.
Experience with AWS services like Lambda, Kinesis, S3, and IAM in conjunction with MSK.
Familiarity with CI/CD tools and practices, as well as IaC tools like CloudFormation, Terraform, or CDK.
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues.
Excellent communication and collaboration skills, with the ability to work effectively across teams.
Nice to have skills
AWS Certified Solutions Architect, AWS Certified Developer, or similar AWS certification
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues.
Excellent communication and collaboration skills, with the ability to work effectively across teams.
Ability to manage multiple priorities and projects in a fast-paced environment.
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Minimum of 5 years of experience in event-driven architectures and streaming solutions.
Proven experience with Apache Kafka, with at least 2 years specifically in AWS MSK.
Experience in designing and implementing high-throughput, low-latency streaming applications in AWS environments.
Strong understanding of Kafka internals, including partitions, brokers, consumer groups, and message serialization formats.
Proficiency in programming languages such as Java, Python, or Scala for building streaming applications.
Experience with AWS services like Lambda, Kinesis, S3, and IAM in conjunction with MSK.
Familiarity with CI/CD tools and practices, as well as IaC tools like CloudFormation, Terraform, or CDK.
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues.
Excellent communication and collaboration skills, with the ability to work effectively across teams.
Nice to have skills
AWS Certified Solutions Architect, AWS Certified Developer, or similar AWS certification
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues.
Excellent communication and collaboration skills, with the ability to work effectively across teams.
Ability to manage multiple priorities and projects in a fast-paced environment.
Quyền lợi
You'll love working with us if you are:
Passionate about technology.
Independent but also a good team player.
Comfortable with a high degree of ambiguity.
Focused on usability and speed.
Keen on presenting your ideas to your peers and management.
At TYME, opportunities are here for the taking. If you want to be part of our purpose and live and lead through our values, we can offer exciting development opportunities through expanded lateral roles, stretch assignments, or people leadership.Some of our benefits:
Meal and parking allowances are covered by the company.
Full benefits and salary rank during probation.
Insurances such as Vietnamese labor law and premium health care for you and your family.
SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
Values-driven, international working environment, and agile culture.
Overseas travel opportunities for training and work-related.
Internal Hackathons and company events (team building, coffee run, etc.).
Pro-Rate and performance bonus.
15-day annual + 3-day sick leave per year from the company.
Work-life balance 40-hr per week from Mon to Fri.
Passionate about technology.
Independent but also a good team player.
Comfortable with a high degree of ambiguity.
Focused on usability and speed.
Keen on presenting your ideas to your peers and management.
At TYME, opportunities are here for the taking. If you want to be part of our purpose and live and lead through our values, we can offer exciting development opportunities through expanded lateral roles, stretch assignments, or people leadership.Some of our benefits:
Meal and parking allowances are covered by the company.
Full benefits and salary rank during probation.
Insurances such as Vietnamese labor law and premium health care for you and your family.
SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
Values-driven, international working environment, and agile culture.
Overseas travel opportunities for training and work-related.
Internal Hackathons and company events (team building, coffee run, etc.).
Pro-Rate and performance bonus.
15-day annual + 3-day sick leave per year from the company.
Work-life balance 40-hr per week from Mon to Fri.
Thông tin chung
- Thu nhập: Thỏa thuận
Cách thức ứng tuyển
Ứng viên nộp hồ sơ trực tuyến bằng cách bấm nút Ứng tuyển bên dưới:
Hạn nộp: 24/11/2024
Giới thiệu công ty
Xem trang công ty
CMC Global ra đời từ kinh nghiệm 25 năm trong lĩnh vực ICT và hơn 10 năm kinh nghiệm trong lĩnh vực Outsourcing của Tập đoàn công nghệ CMC, với sứ mệnh trở thành đơn vị cung cấp nhân lực kỹ sư phần mềm chất lượng cao, cung cấp các giải pháp, dịch vụ CNTT cho thị trường quốc tế. Hiện CMC Global đang sở hữu đến 700++ nhân viên, cùng một công ty thành viên tại Nhật Bản. Tập đoàn công nghệ CMC cùng CMC Global tự hào là một trong những doanh nghiệp hàng đầu Việt Nam trong lĩnh vực phát triển, cung...
Quy mô công ty
Từ 5000 - 10000 nhân viên
Việc làm tương tự
Công Ty TNHH Phần Mềm DTS Việt Nam
5.000.000 - 7.000.000 VND
11/12/2024
Hà Nội
Công Ty TNHH Phần Mềm DTS Việt Nam
8 triệu - 13 triệu VND
04/12/2024
Hà Nội
CÔNG TY CỔ PHẦN CÔNG NGHỆ MOBIWORK VIỆT NAM
Từ 12 - 18 triệu VND
12/12/2024
Hà Nội
hỗ trợ doanh nghiệp
Giải thưởng
của chúng tôi
Top 3
Nền tảng số tiêu biểu của Bộ
TT&TT 2022.
Top 15
Startup Việt xuất sắc 2019 do VNExpress tổ chức.
Top 10
Doanh nghiệp khởi nghiệp sáng tạo Việt Nam - Hội đồng tư vấn kinh doanh ASEAN bình chọn.
Giải Đồng
Sản phẩm công nghệ số Make In Viet Nam 2023.