Senior Software Engineer, Performance Optimizations for LLM

info_outline
XIn accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
Health, dental, vision, life, disability insurance
Retirement Benefits: 401(k) with company match
Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days per year
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Sunnyvale, CA, USA; Kirkland, WA, USA.
Minimum qualifications:
Bachelor's degree or equivalent practical experience.
5 years of experience programming in Python or C++.
3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
3 years of experience with large language model (LLM) concepts, algorithms, and experience designing NLP solutions.
3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, and debugging).
Preferred qualifications:
Experience with modern deep learning toolkits (e.g., JAX).
Experience developing and optimizing LLMs.
Experience working on GPUs or TPUs.
Experience with latency, memory, compute, and quality tradeoffs as they apply to ML model architectures.
Experience with low-level ML model optimization, new architectures, and tools.