Staff Software Engineer - Fleet Management

The role

Nscale is hiring a Staff Software Engineer to build Fleet Manager — the workflow automation platform that provisions, tests, and remediates GPU nodes and network switches at scale.

This role sits at the intersection of distributed systems, infrastructure automation, and physical hardware. You'll own domain-level architecture within Fleet Manager: Python-based systems that manage the entire operational lifecycle of our compute infrastructure, from initial device enrollment through multi-day burn-in testing to ongoing health monitoring and automated remediation. The problems are challenging and the stakes are high — the software you design and build determines how quickly and how reliably Nscale scales its GPU fleet to meet demand.

All jobs

Staff Software Engineer - Fleet Management

Nscale, US +1

Posted pay

$220K–$320K

a year

Compared with similar jobs

This base pay is above the median for staff software engineering jobs in other US places.

Median: $220K a year
Other jobs in the group: 486

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.

Location: US +1
Work type: Not given
Level: Staff
Skills in the job text: Python
AWS
Kubernetes
GCP
Terraform
Airflow
Posted: Aug 7, 2026
Last check: 10 h ago
Job type: Software engineering, Inference & ML systems, ML / AI engineering

Apply on the Nscale site Sign in to save

The Nscale site opens in a new tab.

Nscale

Open tech jobs: 102
With posted pay: 53%
Median posted base: $178K–$260K

About Nscale: funding, hiring and pay

Nscale

About Nscale: funding, hiring and pay

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

The role

Nscale is hiring a Staff Software Engineer to build Fleet Manager — the workflow automation platform that provisions, tests, and remediates GPU nodes and network switches at scale.

What you will do

What you'll work on

Device provisioning and enrollment: automation that takes bare-metal GPU nodes and network switches from first power-on to production-ready — BMC configuration, DHCP reservations, and provisioning state machines.
Burn-in and validation: multi-day testing workflows that qualify hardware before it enters, and re-enters, the fleet.
Workflow orchestration: durable, event-driven state machines that span multiple days, survive crashes, resume from checkpoints, support human-in-the-loop approval gates, and let thousands of concurrent idempotent workflows run without stepping on each other.
GPU health monitoring and self-healing: detection, diagnosis, and automated remediation workflows that keep nodes healthy in production.
Network configuration: switch lifecycle automation and network state management across the fleet.
Integrations: keeping Fleet Manager consistent with datacenter inventory tooling (DCIM, NetBox), bare-metal provisioning systems (MAAS, Ironic, IPMI), credential stores, and monitoring infrastructure.
Observability: structured logging, metrics, distributed tracing, and tooling that lets operators troubleshoot effectively.

Responsibilities

Domain-level technical direction. Own the architecture for a major Fleet Manager domain — such as provisioning, validation, or remediation — influencing engineers across the team and adjacent squads.
Design and build production-grade automation. Implement device provisioning, burn-in testing, network configuration, and hardware health validation workflows in Python.
Engineer for reliability and auditability. Treat idempotency, resumability, checkpointing, retries, replay, and failure handling as first-class design concerns.
Integrate broadly. Connect Fleet Manager with datacenter infrastructure management systems, cloud orchestration platforms, and bare-metal provisioning tools.
Create leverage through standards. Establish shared patterns, libraries, conventions, and operational runbooks that other engineers build on.
Own production outcomes. Operate what you build with strong observability, alerting, incident response, and day-2 operational discipline.
Mentor and influence. Raise the bar through design reviews, implementation guidance, and operational best practices.
Use AI to accelerate delivery while maintaining architectural coherence.

Staff Software Engineer - Fleet Management

The role

Staff Software Engineer - Fleet Management

The role

What you will do

What you'll work on

Responsibilities

What you need

Nice to have

Pay and benefits

About Nscale

Similar jobs at other companies

Software Engineer, GPU Infrastructure - HPC

Software Engineer, Fleet Infrastructure

Software Engineer, Fleet Management

Software Engineer — Fleet

Senior Software Engineer - Fleet Engineering

Software Development Engineer — GPU Fleet Management & AI Infrastructure

Nscale

Compared with similar jobs