Senior AI Engineer

Make a proposal of AI solution in align with a set of customer requirements and goal.
Build and lead a team, enhancing overall technical capabilities and performance.
Optimize Large Language Models (LLMs) & AI models, including:
Efficient training of LLMs (DeepSpeed, FSDP, LoRA)
Deploying models with Kubernetes, Ray, Triton Inference Server
Optimizing model inference speed with ONNX, TensorRT, GGUF, vLLM
Implementing Retrieval-Augmented Generation (RAG) pipelines
Applying AI distillation and quantization techniques
Work with HPC infrastructure and distributed AI computing.
Implement system monitoring tools (htop, tcpdump, iostat, netstat).
Troubleshoot AI system performance bottlenecks.