Jobs Ask AI Pay Companies CompareSign in

Wait…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Principal Software Engineer - Fleet Management

Nscale, AMER +1

Posted pay

$240K–$400K

a year

Location: AMER +1
Work type: Not given
Level: Principal
Experience: 12+ years
Skills in the job text: Python
AWS
Kubernetes
GCP
Terraform
Airflow
Posted: Oct 6, 2026
Last check: 10 h ago
Job type: Software engineering, Inference & ML systems

Apply on the Nscale site Sign in to save

The Nscale site opens in a new tab.

N

Nscale

About Nscale: funding, hiring and pay

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Sign in to check your fit

The role

We're hiring a Principal Software Engineer to lead the technical development of our Fleet Manager platform - the workflow automation system that provisions, tests, and remediates GPU nodes and network switches at scale.

As technical lead, you'll own the architecture and delivery of foundational Python-based automation systems that manage the entire lifecycle of our compute infrastructure: device enrolment, burn-in testing, network configuration, GPU health monitoring, and self-healing capabilities. You'll mentor a team of senior engineers, set technical direction, and drive engineering excellence while remaining hands-on with critical systems.

What you will do

Lead technical architecture and roadmap for Fleet Manager's workflow automation systems
Own end-to-end delivery of device provisioning, validation, testing, and remediation workflows at scale
Design and build workflow orchestration systems for GPU node and network switch lifecycle management
Establish engineering standards for reliability, observability, and operational excellence across all Fleet Manager services
Mentor and raise the bar for a team of senior engineers through design reviews, technical leadership, and hands-on collaboration
Drive architecture decisions balancing automation complexity, reliability, and maintainability
Integrate with infrastructure tooling: DCIMs, NetBox, OpenStack, bare metal APIs (MAAS, Ironic, IPMI)
Partner with Infrastructure, Platform, and SRE teams to translate operational needs into robust, scalable automation
Build production-grade Python systems for hardware lifecycle automation, leveraging AI tools to accelerate delivery

What you need

You have 12-15+ years software engineering experience building and operating production systems, with proven technical leadership in infrastructure automation or workflow tooling
Strong Python engineering fundamentals with experience leading complex, multi-service distributed systems
You are driven by building distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement
Technical expertise: quickly understanding systems design tradeoffs, keeping track of rapidly evolving software systems
Track record of owning technical roadmaps and delivering large-scale automation systems from ambiguous requirements to production
You use AI tools like Claude or Cursor as a core part of your development workflow - as a fundamental multiplier of what you can build
Deep understanding of operational excellence: SLOs, monitoring, alerting, incident response, and production reliability
Strong mentorship skills with ability to develop high-performing engineering teams
Excellent communication skills to build consensus with stakeholders, both internally and externally

Strong candidates will have

Experience with workflow orchestration tools like Temporal, Airflow, Prefect, or similar
Hands-on experience with infrastructure tooling: DCIMs, NetBox, OpenStack, or ERP systems
Bare metal provisioning and automation: MAAS, Ironic, IPMI, PXE boot, or network automation
Experience building hardware lifecycle automation: provisioning, validation, testing, or remediation workflows
GPU infrastructure experience: health monitoring, burn-in testing, or cluster management
HPC and networking: datacenter topology, high-performance interconnects (InfiniBand, RoCE)
Deep knowledge of Kubernetes, Infrastructure as Code (Terraform, Pulumi), AWS, and GCP
Track record of 1+ years leading large-scale, complex projects or technical teams
Open-source contributions in infrastructure automation or cloud-native tooling

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Pay and benefits

$240,000—$400,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

About Nscale

Nscale is building a vertically integrated GenAI cloud from sustainable data centers to advanced AI infrastructure and enterprise applications. Our culture values open collaboration, ownership, and excellence.

Read the job posting on the Nscale site

Similar jobs at other companies

Software Engineer, Fleet Management
OpenAISan Francisco +1
- Software engineering
$230K–$490K / yr
Posted Nov 19, 2025
Software Engineer, Fleet Infrastructure
OpenAISan Francisco +1
- Infra, platform & SRE
$230K–$490K / yr
Posted Feb 13, 2025
Staff Site Reliability Engineer
Hippocratic AIMenlo Park, CA
- Staff
- Onsite
- Infra, platform & SRE
- 2 positions
Pay not posted
Posted Sep 17, 2026
Principal Software Engineer, Cloud Infrastructure
NVIDIAUS, CA, Santa Clara
- Principal
- Onsite
- Infra, platform & SRE
- 2 positions
$272K–$431K / yr
Posted 2 days ago
Software Engineer, GPU Infrastructure - HPC
OpenAISan Francisco +1
- Inference & ML systems
$230K–$490K / yr
Posted Feb 5, 2026
Senior Software Engineer - Fleet Engineering
LambdaSan Francisco Office (Fremont St) +2
- Senior
- Hybrid
- Software engineering
$230K–$395K / yr
Posted May 11, 2026

Source: the Nscale Greenhouse job board. We last checked this job 10 h ago. We first saw it 5 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.

N

Nscale

Open tech jobs: 102
With posted pay: 53%
Median posted base: $178K–$260K

About Nscale: funding, hiring and pay

Compared with similar jobs

This base pay is above the median for principal software engineering jobs in other US places.

Median: $229K a year
Other jobs in the group: 245

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.