DevOps Engineer - AI Runtime Services

AI Runtime Services owns the shared runtime that AI at Demandbase runs on — two ways. First, it's the layer that enables and supports the AI features in the Demandbase platform: product teams ship LLM features on top of it without reinventing model access, spend control, safety, and observability. Second, the team builds and supports internal AI solutions — the tooling and services the company uses to work with LLMs day to day. The pillars underneath both: the LLM gateway, cost controls, observability, evals infra, caching, and guardrails.

The surface is broad and the team is early. You won't be handed a narrow slice: expect to move across the gateway one week and the ingest pipeline the next — and across product-facing runtime and internal tooling — and to own what you build in production.

• The LLM gateway. The single front door to every model provider we use — keys, routing, rate limits, failover, provider quotas. When it's down, every AI feature at Demandbase is down.
• Reliability, for real. SLOs, on-call, incident response, and the postmortems for the runtime. This is a genuine SRE ownership role, not "build it and let someone else run it."