Lead Software Engineer - Java/Python with AI
JPMorgan Chase & Co., Bengaluru, Karnataka, India
JPMorgan Chase & Co., Bengaluru, Karnataka, India
Paste your résumé. You get a résumé and a cover letter for this job, from only the facts in your résumé. Then you apply on the JPMorgan Chase & Co. site.
As a Lead Software Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.
troubleshoot LLM powered applications and services (e.g., retrieval augmented generation, agent workflows, structured extraction, classification) with a willingness to think beyond routine approaches to break down technical problems and deliver measurable outcomes and think in the novel Agentic AI way.
practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
guardrails for prompts, retrieved context, model inputs/outputs, and post processing, including PII redaction, toxicity/safety filters, hallucination mitigation, output schema validation, and policy compliance.
incidents, model and prompt rollouts/rollbacks, dependency issues (vector stores, embeddings, feature stores), and ensure high availability, reliability, and adherence to SLAs including latency and cost budgets.
cases supporting markets workflows with disciplined change management, canary releases, A/B tests, and close partnership with product, controls, and operations.Create secure, high quality production code: implement LLM assisted micro services, synchronous and asynchronous inference pipelines (streaming where appropriate), deterministic fallbacks, circuit breakers, and observability for reliability in production.
lineage, RAG/agent reference architectures, prompt libraries and versioning strategies, evaluation plans, and control evidence ensuring design constraints and regulatory expectations are met during development.
and context analytics, and drift detection to improve model selection, prompt strategies, retrieval quality, chunking/embedding strategies, and system architecture.Drive LLM Ops best practices, integrate models, prompts, and evaluation into CI/CD, enforce approvals, segregation of duties, and reproducibility, automate regression and guardrail tests and manage lifecycle across environments.
documented, and appropriately applied across different classes of software work, and maintain deep understanding of the strengths, limitations, and risk characteristics of approved LLMs (e.g., Claude, ChatGPT, and successor models), including safety profiles, context limits, determinism strategies, and fine tuning vs. prompt only tradeoffs, design multi agent workflows that incorporate LLM driven analysis, code generation, testing, and review with explicit human approval gates and segregation of duties.
expectations, including disaster recovery, fallback behaviors, regional resiliency, and performance SLOs.
requirements analysis, code generation and refactoring, test generation, documentation and explanation, and lead the use of LLMs for structured requirements analysis, translating business and regulatory requirements into clear technical specifications and control implementations.
prompts and system instructions as versioned, reviewable engineering artifacts and ensuring change control and traceability, ensure prompt strategies support determinism, reproducibility, and traceability in regulated environments (e.g., seeded examples, constrained decoding, output schemas, and canonical evaluation sets), and oversee prompt libraries and reusable patterns aligned with enterprise coding and architectural standards, including shared retrieval components and guardrail policies.
and LLM driven software coding. An engineer who is self-motivated, take full ownership of every task given, and act without waiting to be asked. Accountability is key for this role: one'll be expected to spot problems early, see each one through to the fix.
micro services, retrieval pipelines, evaluators, and data tooling; solid understanding of data structures, algorithms, and object oriented programming as applied to LLM latency, caching, and throughput.
Dynamo DB, Aurora, Data bricks), plus experience integrating managed model endpoints and embedding/vector services; familiarity with secure secret management, networking, and least privilege access.
extensions: prompt and config versioning, automated evaluations, canary releases, and rollback strategies.
stability for LLM architectures, including retrieval layers, vector stores, caching, observability, rate limiting, and backpressure strategies.
ability to explain model behaviors, tradeoffs, and control decisions to both technical and non technical stakeholders.
triage, run book retrieval, and pre approved auto remediation, with on call coverage for LLM services and dependencies.
experience training and fine-tuning approved models (e.g., Claude, Chat GPT and successors), with a proven track record integrating LLMs as controlled, reliable components of the software engineering lifecycle in regulated environments, ensuring determinism, reproducibility, safety, and traceability
contexts, embeddings, chunking strategies, vector similarity nuances, retrieval quality measures, and document lineage.
software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
Pay not posted
Posted Jul 27, 2026
Pay not posted
Posted Jun 15, 2026
Woven by ToyotaPalo Alto, CA +1
$189K–$311K / yr
Posted 22 days ago
Pay not posted
Posted Dec 10, 2024
Source: the company job board. We last checked this job 2 h ago. We first saw it 2 h ago. A job on a job board does not always mean that the team interviews people now.
Pay not posted
Posted Oct 9, 2026
Pay not posted
Posted Oct 6, 2026
No one has reported an interview at JPMorgan Chase & Co. yet. Did you interview there? Add the questions.