Software Engineer - Dedicated Inference
Baseten, San Francisco +4
The role
As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage mission-critical inference deployments.
Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers.
What you will do
- Implement new features and products for the team
- Design ergonomic APIs and abstractions to solve customer problems
- Fix bugs and resolve customer issues with urgency
- Work across the stack – regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
- Work closely with the product and forward deployed engineering teams to develop and drive new product ideas