[Remote] Senior AI Engineer (Agent OS Platform)
Note: The job is a remote job and is open to candidates in USA. ServiceTitan runs the businesses behind the trades and is building Agent OS to enhance operational context into safe, observable, production-grade agent work. The Senior AI Engineer will help build core engineering primitives for the Agent OS platform, including agent runtime, context systems, and trust infrastructure, while collaborating with various teams to ensure the platform's reliability and performance.
Responsibilities
- Design and implement core Agent OS platform services
- Write production code and review implementation details from other engineers
- Build reliable APIs, workflows, tools, and services for agent execution
- Inspect traces, debug failures, and improve production behavior
- Design evaluation scenarios and regression suites for agent workflows
- Work through real agent failure modes: stale context, wrong tool calls, missing permissions, unsafe actions, poor retrieval, latency spikes, and cost regressions
- Partner with domain teams to turn agent use cases into reusable platform patterns
- Help define platform contracts for tools, actions, approvals, context, memory, evidence, and evaluation
- Contribute to technical direction while staying grounded in what can ship quickly and safely
- Communicate clearly with engineers, product managers, architects, security partners, and engineering leadership
Skills
- 5+ years of production software engineering experience
- Strong hands-on coding ability in Python, Java, C#, or another backend language. Python experience is strongly preferred
- Experience building AI, ML, data, platform, infrastructure, workflow, automation, or developer-platform systems in production
- Practical understanding of modern LLM application architecture: model gateways, prompt and context assembly, retrieval, tool calling, structured outputs, memory, agent workflows, and human approval patterns
- Experience with distributed systems, event-driven systems, async workflows, queues, durable execution, or message-driven architectures
- Strong production-safety instincts for non-deterministic systems: typed contracts, scoped permissions, precondition checks, idempotency, audit trails, rollback, and monitoring
- Experience designing or operating evaluation systems: behavioral evals, regression suites, scenario tests, trajectory review, simulation, online metrics, or production monitoring
- Strong data and context instincts: SQL, unstructured data, vector search, metadata, provenance, freshness, source authority, and privacy boundaries
- Experience with databases, warehouses, or search systems such as PostgreSQL, SQL Server, Snowflake, BigQuery, Elasticsearch, or vector stores
- Experience building services on public cloud infrastructure such as Azure, AWS, or GCP
- Good engineering judgment across APIs, reliability, security, observability, and multi-tenant SaaS constraints
- Experience building or operating agent runtimes, workflow engines, model gateways, ML platforms, evaluation platforms, developer platforms, or internal control planes
- Experience with LangGraph, LangChain, LlamaIndex, Semantic Kernel, OpenAI Agents SDK, Anthropic tooling, or similar frameworks
- Experience with MCP, A2A, tool protocols, agent interoperability, or agent-commerce patterns
- Experience with Kubernetes, Docker, serverless platforms, or cloud-native infrastructure
- Experience with compliance-sensitive workflows, approval-gated automation, audit trails, policy engines, or governed writes to systems of record
- Experience in SaaS, vertical software, fintech, ERP, CRM, marketplace, field service, or other domains where software decisions affect real business operations
- Experience with graph-based data models, knowledge graphs, entity resolution, or cross-domain operational context systems
Benefits
- Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career.
- We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events.
- Great work is rewarded through Bonusly, peer-nominated awards, and more.
- Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.
- Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.
Company Overview
Company H1B Sponsorship