Senior Software Engineer for AI Agent platform

As a Senior Software Engineer - Backend (AI Agent Platform), you will play a key role in designing, developing, and deploying the backend systems that power our AI agent platform. You will work on challenging problems related to distributed systems, scalability, real-time processing, and the integration of AI/ML models into production. You will work closely with data scientists, machine learning engineers, frontend engineers, and other stakeholders to build a robust and innovative platform. You will be a hands-on developer, writing high-quality code and contributing to architectural decisions.

Key Responsibilities:

Backend System Design & Development:

• Design, develop, and maintain scalable, reliable, and performant backend services for the AI agent platform.
• Implement APIs and microservices for interacting with AI models, data pipelines, and other platform components.
• Write high-quality, well-tested, and maintainable code (primarily in Go, potentially with some Java or Python).

AI/ML Integration:

• Work closely with data scientists and machine learning engineers to deploy and integrate AI/ML models into the platform.
• Develop and maintain infrastructure for model serving, monitoring, and retraining.
• Optimize model performance and scalability in a production environment.
• Experience with deploying LLM and SLM models.

Real-time Processing:

• Design and implement systems for real-time data processing and event handling.
• Work with technologies like WebSockets, message queues (Kafka, RabbitMQ), and streaming platforms.

Data Pipeline Integration:

• Collaborate with data engineers to integrate the AI agent platform with data pipelines for training and inference.
• Work with various data storage technologies (SQL, NoSQL, data warehouses).

Scalability and Performance:

• Design and implement systems that can handle high volumes of data and traffic.
• Identify and address performance bottlenecks.
• Optimize system performance for speed, scalability, and cost-effectiveness.

Security: Implement secure coding practices and work closely with the security team to ensure the security of the platform.

Collaboration:

• Work effectively in a cross-functional team, collaborating with product managers,
• designers, frontend engineers, data scientists, and other stakeholders.
• Communicate technical concepts clearly and concisely.

Mentorship:

• Provide technical guidance and mentorship to junior engineers.
• Participate in code reviews and contribute to improving engineering best practices.

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 5+ years of experience in backend software engineering.
• Strong experience with Go (highly preferred), Java, or Python.
• Experience with building and deploying scalable, distributed systems.
• Experience with containerization and orchestration (Docker, Kubernetes).
• Experience with cloud platforms (AWS, GCP, Azure).
• Experience with databases (SQL and NoSQL).
• Experience with message queues (Kafka, RabbitMQ) or streaming platforms.
• Experience with real-time communication technologies (WebSockets) is a plus.
• Experience with integrating AI/ML models into production systems is a significant plus.
• Experience with MLOps tools and practices is a plus.
• Experience with LLMs/SLMs, agent frameworks, or vector databases is a strong plus.
• Experience working in an Agile environment.
• Experience working in Vietnam or Southeast Asia is a plus.

Required skills:

• Strong backend engineering skills.
• Solid understanding of distributed systems concepts.
• Familiarity with AI/ML concepts and technologies.
• Excellent problem-solving and analytical abilities.
• Good communication and collaboration skills.
• Passion for building high-quality, scalable, and secure systems.
• Fluency in English, Vietnamese proficiency is a plus.

• Competitive salary and benefits package.
• Premium health insurance for you and your family.
• Annual leave 12 days per year + 1 Birthday Leave + 1 X'Mas
• Performance review: once per year
• Opportunity to work on products that impact millions of users.
• A dynamic and supportive work environment.
• Professional growth and development opportunities.
• Internal training/sharing and professional training courses
• Team building, company trip, year end party, monthly activities,....
• Devices: Macbook and screen (If needed)
• Free tea and coffee
• Working hour: 9am - 6pm from Monday to Friday