Staff Software Engineer, AI Agent Architecture for Google Cloud Business Platforms

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day.

As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

As a tech lead, you will lead the architecture and development of EGI Foundry (Enterprise AI Platforms and Agent Architecture.) —our platform for building, composing, and operationalizing enterprise intelligence applications (adapting modern AI platform paradigms to Google's enterprise scale). You will design deep ontology to model enterprise workflows, documents, and data entities, enabling agents to reason over complex enterprise contexts with high fidelity.

You will manage fundamental challenges at the intersection of large-scale systems and generative AI: from architecting agent composition frameworks and generative UIs to designing automated learning loops that continuously improve agent accuracy from human operator feedback.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google [https://www.google.com/about/careers/applications/benefits/].

• Lead the technical design and implementation of EGI Foundry, providing the

foundation, runtime, and interfaces for rapidly developing, deploying, and orchestrating enterprise AI applications.

• Architect graph representations, property graph libraries, and ontology

services (including GoogleSQL graph integration) to model enterprise processes, document relationships, and system understanding for multi-agent workflows.

• Partner on next-generation Human-in-the-Loop (HITL) frameworks, designing

feedback loops that automatically convert human corrections into improved prompts, fine-tuning datasets, and verification benchmarks for hard-to-verify tasks.

• Build robust, low-latency, and compliant integration points with core Cloud

and Alphabet systems (Salesforce, SAP, Vertex AI, Gemini Enterprise).

• Set technical direction, author high-impact design docs, lead architecture

reviews, and mentor engineers. Collaborate with partners including Cloud AI, Core Data Insights, and Finance Engineering.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years

of experience with software design and architecture.

• 5 years of experience leading ML design and optimizing end-to-end Machine

Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).

• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large

Vision Models) or with GenAI-related concepts (language modeling, computer vision).

• Experience in AI Platforms/Gen AI Agents and Large-scale Distributed Systems.

• Master’s degree or PhD in Engineering, Computer Science, or a related

technical field.

• 8 years of experience with data structures/algorithms.
• 3 years of experience in a technical leadership role leading project teams

and setting technical direction.

• 3 years of experience working in a complex, matrixed organization involving

cross-functional, or cross-business projects.

• Experience with HITL workflows, rater feedback loops, automated

evaluation/auto-raters, or model distillation pipelines.

• Experience with Google Cloud Platform technologies.