Senior ML Inference Systems Engineer | Remote ... AD

Cast AI is seeking a senior ML inference infrastructure engineer to optimize throughput, latency, and cost across our GPU fleet. You will tune loaders, schedulers, and KV caches, ensuring scalable, mu...

Senior Applied ML Engineer — Real-Time LLM ... AD

Cast AI is hiring for an applied ML Platform Engineer to own the routing model end to end. You will define features, objectives, training, calibration, and release cadence, ensuring production-parity ...

Senior Applied ML Engineer | Kimchi (Model ... AD

Why Kimchi?Great models are raw ingredients. Kimchi is what happens when you ferment them with good engineering. We started inside CAST AI helping companies run LLMs on their own Kubernetes clusters; ...

Senior ML Inference Systems Engineer | Remote ...

Cast AI is seeking a senior ML inference infrastructure engineer to optimize throughput, latency, and cost across our GPU fleet. You will tune loaders, schedulers, and KV caches, ensuring scalable, mu...

Senior Applied ML Engineer — Real-Time LLM ...

Cast AI is hiring for an applied ML Platform Engineer to own the routing model end to end. You will define features, objectives, training, calibration, and release cadence, ensuring production-parity ...