Senior ML Engineer | Kimchi (LLM Inference Optimization)
- Type
- Job
- Organization
- Kimchi
- Location
- Remote
- Deadline
- Rolling or not stated
- Who can apply
- On-site in Remote
- Posted
- 4 October 2026
- Visa sponsorship
- The listing says no
- Skills mentioned
- Kubernetes, Python, PyTorch, PostgreSQL, Google Cloud, AWS, Azure
About this Opportunity
Why Cast AI? Cast AI is an automation platform that operates cloud-native and AI infrastructure at scale.
Eligibility
- 5+ years building real ML systems, with a portfolio that shows depth in inference or training infrastructure (not just model training notebooks).
- Strong Python - production services, not scripts.
- Hands-on experience with at least one of vLLM, SGLang, or TensorRT-LLM, and a working mental model of why an inference engine performs the way it does on a given GPU.
- Fluency with quantization tradeoffs - you've measured quality regressions, not just compression ratios.
- Comfort with distributed systems: collective communication, sharding strategies, and the practical failure modes of multi-GPU and multi-node setups.
- A bias toward measurement.
Documents you may need
- Updated CV / Resume
- Cover Letter (tailored to this role)
- Portfolio / Work Samples
How to apply
- Click the "Apply — via Arbeitnow" button to go to the source page.
- Read the full description and confirm you meet the requirements.
- Prepare your CV and cover letter tailored to this role.
- Submit your application through the official portal.
- Follow up within 1–2 weeks if you do not hear back.
Similar opportunities
- Senior ML Engineer | Kimchi (Inference Stack Optimization)
- Senior Machine Learning Engineer, LLM Inference Optimization
- Staff Machine Learning Engineer, LLM Inference Optimization
- AI Research Engineer (Kernel & Inference Optimization)
- Senior IA Inference Engineer (x/f/m)