Senior Software Engineer, AI Gateway - Shanghai

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.

As Kong advances into the Agentic Era, the AI Gateway team is developing the vital infrastructure that links enterprise systems with generative AI technologies. In this position, you will focus on engineering the core system powering live AI traffic. You will take ownership of the runtime and data plane responsible for routing, translating, securing, and analyzing every request, ensuring performance, security, and scalability as AI workloads expand.

• Responsible for designing, building, and maintaining Kong's AI Gateway runtime and its underlying data plane stack.
• Architect, design, and implement new innovative features, including proxying capabilities, semantic/intelligent routing, load balancing, guardrails and compression, and identity, that extend Kong's AI Gateway offering.
• Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.
• Partner with technical support engineers to resolve customer-reported issues end to end — from investigation and solution design through coding and release.
• Engage with the open source community and extend Kong core to support the latest industry trends.
• Fill the gaps between Kong AI Gateway and third-party AI/ML providers, deployment platforms, and tooling.
• And any additional tasks required by the manager.

• 6+ years of programming experience in server-side applications and components.
• Experienced in designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
• Solid hands-on, low-level technical expertise in Linux systems troubleshooting and profiling.
• Experienced in distributed systems, the Linux networking stack, and computer systems programming.
• Solid design and coding practices; skilled at code review and mentoring junior engineers.
• Comfortable working with remotely distributed teams.
• Excellent verbal and written communication skills across stakeholder groups: including engineers, product managers, support engineers, and customers.
• Strong sense of ownership, self-driven and proactive, with the ability to take initiative and drive work forward to tangible outcomes.
• Able to handle urgent issues under pressure while maintaining high quality, even in emergency situations.
• Familiar with AI LLM concepts and application development.

• Hands-on experience with NGINX/OpenResty/Kong/LuaJIT.
• Hands-on experience with Envoy or Istio.
• Hands-on experience with Rust.
• Hands-on experience leveraging AI agents to deliver intricate software systems efficiently and with superior quality.

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com http://www.konghq.com.