Skip to main content

Baseten

OS / K8s Systems Engineer

San Francisco (Remote)$165k–$330kfulltimemidAdded 1 month ago

About this role

Baseten seeks a senior OS/Kubernetes systems engineer to design and automate the infrastructure layer that converts raw GPU hardware into production-ready compute clusters. You'll own provisioning pipelines, OS image creation, and cluster orchestration to enable rapid, reproducible infrastructure deployments across data centers.

What you'll do

  • Design and implement end-to-end automation for cluster provisioning and lifecycle management
  • Build OS images, provisioning systems (PXE or equivalent), and configuration management pipelines
  • Deploy and operate Kubernetes, Slurm, or similar cluster orchestration platforms
  • Ensure reproducible infrastructure deployments across multiple sites and hardware generations
  • Automate system upgrades, rollouts, and failure recovery mechanisms
  • Optimize GPU utilization, networking performance, and collaborate with hardware teams

What they're looking for

  • Infrastructure automation and systems design
  • Linux kernel, boot processes, drivers, and performance tuning
  • Programming in Python, Go, or similar languages
  • Kubernetes orchestration and management
  • Provisioning systems and OS imaging
  • Multi-layer debugging (hardware, OS, networking)
  • GPU or high-performance computing experience
  • Configuration management tools

Benefits

  • Competitive compensation with meaningful equity
  • 100% medical, dental, and vision insurance for employee and dependents
  • Flexible PTO with company-wide winter break closure
  • Paid parental leave and fertility/family-building stipend
  • Company-facilitated 401(k)
  • Exposure to leading AI startups and learning opportunities
Apply with Autofill

Opens the application — the Jobs AI extension fills it for you. Set up autofill

Opens the official application on the employer’s site. No login required.

Baseten

Baseten builds an AI inference platform that enables companies to deploy and manage machine learning models in production at scale. The company is hiring software engineers, infrastructure specialists, and product engineers to develop observability systems, frontend experiences, reliability infrastructure, developer tools, and enterprise deployment solutions.

View all jobs at Baseten

Likely interview questions

  • Walk us through your experience building automated provisioning systems. How have you approached zero-to-cluster automation at scale?
  • Describe a time you debugged a complex issue spanning hardware, OS, and network layers. How did you isolate and resolve it?