DoorDash USA
Software Engineer, Machine Learning Infrastructure - Generative AI
About this role
Join DoorDash's GenAI Platform team to build shared infrastructure enabling safe, scalable generative AI products across DoorDash, Wolt, and Deliveroo. You'll design and maintain production systems including LLM gateways, agent orchestration, model serving, and evaluation infrastructure that accelerate AI-powered features from prototype to production.
What you'll do
- Design and build scalable GenAI platform surfaces including LLM Gateway, Agent Gateway, and model serving infrastructure
- Develop evaluation systems, batch inference pipelines, and guardrails for production AI agents and automation
- Partner with ML engineers and product teams to convert emerging GenAI capabilities into reusable platform primitives
- Ensure production systems meet latency, scale, monitoring, and SLO requirements with strong operational excellence
- Support rapid experimentation while maintaining reliability, observability, cost controls, and vendor abstraction
- Enable product teams to choose optimal model and vendor strategies across closed-source and open-weight options
What they're looking for
- Backend engineering fundamentals, particularly Python and distributed systems
- Production service development, APIs, data pipelines, and ML infrastructure at scale
- Systems observability, debugging, reliability, incident response, and performance/cost optimization
- Machine learning workflows including inference, evaluation, model serving, and experimentation
- Ability to navigate ambiguous, fast-moving technical areas and abstract use cases into platform capabilities
- Experience with Kubernetes, cloud infrastructure (AWS/GCP), GPUs, or batch processing systems
- LLM infrastructure knowledge such as gateways, model routing, cost attribution, or evals
- AI agent deployment, RAG/retrieval pipelines, or LLM observability and tracing
Benefits
- 401(k) plan with employer matching
- Comprehensive benefits package for regular employees
- Equity grant opportunities
- Work on high-impact GenAI infrastructure shaping DoorDash's AI future
- Collaboration with teams across three global companies (DoorDash, Wolt, Deliveroo)
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
DoorDash USA
DoorDash USA is building autonomous delivery systems including drones and robots, along with internal infrastructure platforms to support large-scale operations. The company is hiring robotics engineers, autonomous systems specialists, infrastructure engineers, and platform software engineers to develop flight control systems, mapping and localization capabilities, and distributed computing platforms.
View all jobs at DoorDash USALikely interview questions
- Walk us through your experience building production LLM inference systems. What inference engine did you use, and how did you optimize for latency, throughput, or cost?
- Describe a time you had to debug or optimize GPU utilization in a production system. What was the bottleneck, and how did you resolve it?