Senior Software Engineer - AI
Web, Quebec, Canada - Remote +2
Web has this job in 1 other place
What you need
Who you are & what you’ll need to succeed
- Translate loosely defined product problems into practical AI solutions, choosing between LLMs, RAG, tool calling, agents, deterministic workflows, or traditional software.
- Design and build production AI services using Python, FastAPI, asynchronous workers, PostgreSQL, Redis, queues, model APIs, and external tools.
- Build reliable tool calling agents and multi step workflows that interact with internal APIs, MCP tools, business systems, and knowledge sources.
- Design event driven systems using RabbitMQ, Kafka, Azure Service Bus, or equivalent platforms, including retries, dead letter handling, idempotency, back pressure, and failure recovery.
- Build and improve RAG systems covering ingestion, chunking, embeddings, hybrid retrieval, reranking, metadata filtering, context construction, and citations.
- Experiment with models from OpenAI, Anthropic, Google, xAI, and open weight ecosystems, selecting the right model for quality, latency, reliability, and cost.
- Create AI evaluation pipelines using curated datasets, regression tests, retrieval metrics, LLM as judge techniques, groundedness checks, and tool execution evaluation.
- Diagnose hallucinations, retrieval failures, incorrect tool usage, agent loops, latency issues, provider failures, and unexpected inference costs.
- Operate as an AI powered engineer using Cursor, Claude Code, OpenAI Codex, or equivalent coding agents to accelerate design, implementation, testing, debugging, and refactoring.
What we’re looking for
- 5 or more years of professional software engineering experience building production backend, distributed, or cloud based systems.
- Hands on experience building Applied AI, LLM, RAG, NLP, or agent based applications, with meaningful production exposure.
- Advanced Python skills including FastAPI, asynchronous programming, Pydantic, SQLAlchemy or SQLModel, and production API development.
- Strong backend and distributed systems fundamentals including REST APIs, concurrency, background processing, caching, reliability, and production debugging.
- Production experience with RabbitMQ, Kafka, Azure Service Bus, or equivalent queue and messaging architectures.
- Hands on experience integrating LLM APIs and building structured output, function calling, tool calling, or agent execution workflows.
- Experience building at least one RAG or knowledge grounded system with measurable quality and latency outcomes.
- Strong PostgreSQL and data modeling skills, with experience using Redis, pgvector, vector databases, or hybrid search technologies.
- Demonstrated use of AI coding agents such as Cursor, Claude Code, Codex, or equivalent tools as a core part of daily software engineering.