Together AI, San Francisco
Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads.
We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.
As inference becomes a larger part of our business, the product surface is becoming more complex. Workloads span different tenancy, capacity, performance, and modality needs; agentic applications are changing how inference is consumed; and customers increasingly expect deep infrastructure capabilities to translate into predictable, easy-to-use products.
This role owns the product layer between Together’s inference infrastructure and the developers and enterprises consuming it. You’ll help define how our portfolio of inference products fits together, where Together should differentiate, how customers move from experimentation to production, and how the developer experience evolves as workloads become more sophisticated.
This is a hands-on technical product role. You’ll use our APIs and SDKs, study real workloads, test integrations, and work closely with inference platform engineers and researchers to turn infrastructure and model capabilities into clear product decisions and customer experiences.
Experience with LLM inference, model serving, distributed systems, GPU infrastructure, agents, or developer-facing AI products is helpful, but not required. We care most about your ability to learn technical systems quickly, get close to the product, and develop strong judgment.
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250 - 300k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy.
FriendliAISan Francisco
Pay not posted
Posted Sep 16, 2026
$205K–$320K / yr
Posted 9 days ago
BasetenSan Francisco +1
$200K–$400K / yr
Posted 3 days ago
NVIDIAUS, CA, Santa Clara
$208K–$380K / yr
Posted 16 days ago
checked 5 days agoBasetenSan Francisco +1
$200K–$400K / yr
Posted 3 days ago
Pay not posted
Posted Mar 15, 2026
Source: the Together AI Greenhouse job board. We last checked this job 4 h ago. We first saw it 8 days ago. A job on a job board does not always mean that the team interviews people now.
No one has reported an interview at Together AI yet. Did you interview there? Add the questions.
Funding records can have errors and can be missing. The company page has the links.
This base pay is above the median for senior product management jobs in the Bay Area.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.