Senior Software Engineer, AI Infrastructure

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you'll do

• Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.

• Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.

• Integrate the serving layer with the platform's API gateway, identity, and metering services.

• Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).

• Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

• What we're looking for:

• 5+ years of software engineering experience in infrastructure, platform, or distributed systems.

• Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.

• Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.

• Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.

• Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.

• Comfortable with high autonomy on a small, remote-first, written-culture team.

• Nice to have:

• Inference performance work (quantization, batching, caching) or distributed serving frameworks.

• Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.

• UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.

• Open-source contributions in the Kubernetes or ML-infrastructure ecosystems

What does Mirantis offer you?

• Work with an established Silicon Valley leader in the cloud infrastructure industry;
• Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
• Be a part of cutting-edge, open-source innovation;
• Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
• Professional development and training;
• Attend conferences and working groups;
• Company outings, happy hours, hackathons, and tech talks;
• Receive a competitive compensation package with a strong benefits plan.
  We are a https://www.g2.com/reports/grid-report-for-container-management-spring-2022.embed?featured=mirantis-kubernetes-engine-formerly-docker-enterprise&secure%5Bgated_consumer%5D=7ed17484-74e3-4ce8-8ad6-b48b395fbf56&secure%5Btoken%5D=f4b909a5c1a2d1aa71dee93761486db5732a5b82abd47aa75f3353da41e3b92c&utm_campaign=gate-817340 Leader for Container Management in G2 (#2 after AWS)!

• Inference performance work (quantization, batching, caching) or distributed serving frameworks.
• Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.
• UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.
• Open-source contributions in the Kubernetes or ML-infrastructure ecosystems