Job Description
Role Overview
We build AI-powered applications and demo products spanning conversational agents, retrieval-augmented generation (RAG), computer vision, real-time data pipelines, and applied ML - deployed as containerized services on cloud infrastructure with automated CI/CD.
Our systems work at the prototype/demo level. We're hiring two Senior/Lead AI Engineers to take them to production-grade: reliable, observable, secure, well-tested, and cost-efficient enough to run as real client-facing products, not just demonstrations.
This is a hands-on senior IC role with technical leadership scope - you'll set standards, make architectural calls, and mentor other engineers.
Key Deliverables & Responsibilities
The kinds of problems you'll solve
- Taking LLM-based systems (RAG pipelines, multi-agent workflows, conversational assistants) from "works in a demo" to reliable under real-world, messy, adversarial, or incomplete input.
- Building the evaluation and quality layers most AI teams lack: regression testing for prompts/agents, hallucination and safety checks, retrieval quality measurement, latency/cost/quality tradeoffs.
- Adding the operational maturity that's usually missing from AI prototypes: observability, alerting, retries/fallbacks, security review, and incident-readiness.
- Improving cloud infrastructure and deployment pipelines so services scale, restart cleanly, and cost less to run.
- Deciding, system by system, what "production-ready" actually requires - and pushing back when a shortcut isn't safe to ship.
- Mentoring other engineers and raising the bar on testing, code quality, and documentation across the team.
Tech stack you'll work in
- AI/LLM engineering: LLM application development, RAG, agentic/tool-using systems, prompt engineering, evaluation and guardrails.
- Backend: Python (modern tooling - package managers like uv, linters like Ruff), with some Node/TypeScript.
- Frontend: React-based frameworks ([protected info]), with internationalization considerations.
- Cloud & infrastructure: AWS (containers, serverless functions, CDN/static hosting), infrastructure-as-code, Docker.
- Quality & delivery: End-to-end testing (Playwright or similar), backend test suites, CI/CD pipelines.
Requirements
- 6+ years in
software engineering, including 2+ years shipping LLM/AI-powered applications to production - not just prototypes or notebooks.
- Strong, practical experience with RAG and/or agentic AI systems and their real failure modes (bad retrieval, hallucination, tool-call errors, context limits).
- Solid Python; comfortable reading/writing in a JS/TS frontend codebase.
- Experience owning services on a major cloud provider with infrastructure-as-code and containerized deployments.
- Demonstrated ability to make AI systems reliable and measurable - testing, evaluation, monitoring, and cost/performance tuning.
- Good product judgment - able to scope "production-ready" pragmatically rather than gold-plating or cutting corners.
- Good English communication
Nice to have
- Experience with computer vision, structured-data/SQL generation, or real-time data pipelines.
- LLMOps tooling (evaluation frameworks, tracing/observability platforms).
- Security or compliance-sensitive project experience (finance, government, or regulated industries).
- Experience with multilingual or RTL-language products.
Benefits
At SmartOSC, we offer the best to your values:
- You'll take real AI systems the last, hardest mile to production - with the autonomy of a senior engineer and real influence over how the team builds AI going forward.
- Attractive salary package
- Salary review twice a year
- Flexible working hours (between 7:30am - 7:30pm on staff's preference)
- Premium health care
- Working in one of the largest digital transformation agencies in Asia - Professional English environment
- Firm's Certified Qualifications Sponsorship for career development
- Annual company trip inside or outside Vietnam
- Other fun activities: happy hour, quarterly team building, football club, yoga club, swimming club, charity activities, etc.
- Free entertainment parties: Birthday party, Anniversary party, Sum-up Party, Year-End Party, etc
Note: By submitting your resume for this position, you acknowledge and consent that the Company may collect, use, store, disclose (where necessary), and otherwise process your personal data for recruitment-related purposes, including evaluating your application, communicating with you, and making hiring decisions. Your personal data may be shared with relevant third parties involved in the recruitment process on a need-to-know basis. You acknowledge and consent that the Company shall retain your personal data for as long as necessary to fulfil the above purposes or to comply with applicable legal obligations. Where permitted by applicable law, you may submit a written request for the deletion of your personal data.