AI Operations Specialist - LLM & Conversation Systems
Pavago, Pakistan
Pavago, Pakistan
AI Operations Specialist – LLM, Prompt Engineering & Conversation Systems | Remote
Position Type: Full-Time, Remote Working Hours: U.S. Business Hours Industry: Artificial Intelligence / SaaS / Telehealth Technology Department: AI Operations / Conversational AI Focus: Production LLM Systems, AI Conversation Optimization & Conversion Performance
At Pavago, one of our clients is hiring a highly skilled AI Operations Specialist to manage, monitor, troubleshoot, and continuously optimize production AI conversation systems.
Our client operates an AI-powered SMS lead recovery platform serving telehealth brands, processing millions of messages every month. These AI systems communicate directly with customers, making conversation quality, reliability, and conversion performance critical to business success.
This is a hands-on, execution-focused role for someone with proven experience operating Large Language Model (LLM) systems in production, rather than simply experimenting with AI tools.
You’ll be responsible for onboarding new clients, configuring AI conversation workflows, managing knowledge bases and integrations, monitoring live customer interactions, identifying AI failure modes, optimizing prompts, and measuring the impact of changes on conversion performance.
The ideal candidate combines technical AI knowledge, prompt engineering expertise, analytical thinking, and operational ownership with the ability to work independently in a fast-moving environment.
You’ll collaborate directly with the founder to ensure AI systems consistently deliver accurate, effective, and conversion-focused customer conversations.
This role requires real-world production AI experience.
Candidates should have hands-on experience managing or improving deployed AI systems that interact with actual users or customers.
Experience limited to experimenting with ChatGPT, creating basic prompts, or exploring AI tools without production responsibilities will not meet the requirements of this position.
Core Technical Focus: Production LLM Operations | Prompt Engineering | Conversational AI | API & Webhook Integrations | AI Quality Assurance | Conversion Optimization
Your day begins by reviewing the performance of live AI conversations, checking for unusual patterns, system failures, or opportunities to improve customer engagement.
You may investigate conversation transcripts to understand why certain leads failed to convert, identify problematic AI responses, or determine whether an issue originates from a prompt, knowledge base, or integration.
Later, you might onboard a new telehealth client by configuring their knowledge base, setting up webhooks, and testing AI conversation workflows before launch.
Throughout the day, you’ll update system prompts, refine conversation logic, and conduct structured tests to evaluate whether your changes improve response quality and conversion performance.
You’ll also analyze performance data, document your findings, and communicate recommendations directly to the founder.
Before wrapping up, you’ll review the results of recent changes, monitor any unresolved issues, and prioritize the next set of improvements.
In short: You’ll operate, troubleshoot, test, and optimize production AI conversation systems to improve reliability, customer engagement, and lead conversion.
This opportunity offers the chance to work directly with the founder of an AI-powered SaaS platform processing millions of customer messages each month.
Unlike traditional AI research or experimentation roles, this position focuses on the practical challenges of managing and improving AI systems that are already operating at scale.
This role is particularly well suited to someone who enjoys combining LLM technology, operational problem-solving, prompt engineering, and conversion-focused analysis.
Position Type: Full-Time Location: Remote Working Hours: U.S. Business Hours
Candidates must be comfortable collaborating with the founder during U.S. business hours and responding to operational priorities involving production AI systems.
Strong communication, independent problem-solving, and consistent availability are essential.
As part of the application process, all candidates are required to complete a one-way video interview through Spark Hire.
After completing the first step of your application, you’ll receive a Spark Hire invitation by email with instructions to record and submit your video responses.
Completion of the Spark Hire video is required to be considered for the next stage. Please check your inbox as well as your spam or junk folder for the invitation.
Apply Now
If you’re an experienced AI Operations Specialist, LLM Operations Specialist, Conversational AI Specialist, Prompt Engineer, or AI Systems Operations Professional with proven experience managing production AI systems, we’d love to hear from you.
This is an opportunity to take ownership of real-world AI conversation systems, improve LLM performance, troubleshoot complex production issues, and directly influence customer engagement and conversion outcomes.
Candidates with hands-on production LLM experience, strong prompt engineering skills, and the ability to independently optimize customer-facing AI systems are encouraged to apply.
#AIOperationsSpecialist #LLMOperations #PromptEngineering #ConversationalAI #ArtificialIntelligence #LLM #GenerativeAI #AIOptimization #AIQualityAssurance #ProductionAI #AIEngineering #ConversationSystems #APIIntegrations #Webhooks #SaaSJobs #ConversionOptimization #TelehealthTechnology #RemoteAIJobs #RemoteJobs
Source: the Pavago Workable job board. We last checked this job 6 h ago. We first saw it 6 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at Pavago yet. Did you interview there? Add the questions.