Note: The job is a remote job and is open to candidates in USA. Level AI is on a mission to turn every customer interaction into a strategic advantage through their AI-native platform. As a Senior Backend Engineer - AI Agents, you will be responsible for building scalable backend systems that power next-generation AI Agents, focusing on real-time, high-volume enterprise environments.
Responsibilities
- Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
- Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
- Build systems for agent memory, context management, and state persistence across interactions
- Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
- Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability
- Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production
- Design and manage event-driven, asynchronous workflows for complex agent tasks
- Optimize systems for high throughput, low latency, and cost-efficient inference at scale
- Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
- Partner closely with Applied AI / ML teams to productionize models and agent behaviours
- Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems
- Drive best practices in observability, monitoring, safety, and guardrails for AI systems
- Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms
Skills
- 5+ years of experience in backend engineering, distributed systems, or platform engineering
- Strong experience building high-scale, production-grade backend systems
- Experience designing systems for real-time processing, streaming, or event-driven architectures
- Strong understanding of API design (REST, gRPC) and microservices architectures
- Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
- Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
- Strong fundamentals in system design, concurrency, and performance optimization
- Experience working with LLMs, conversational AI, or AI-powered products in production
- Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
- Experience building or integrating RAG pipelines, vector databases, or retrieval systems
- Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
- Understanding of prompting strategies, context windows, and model behavior optimization
- Experience with real-time decisioning systems or workflow orchestration engines
Benefits
- Competitive compensation with performance-based upside
- Flexible vacation policy
- Health insurance coverage
- Work with a globally distributed, high-impact team
- Opportunity to build cutting-edge AI products at scale
- Regular team offsites and in-person collaboration
Company Overview
Level AI is a platform for businesses to automate tedious workflows and transform customer experience. It was founded in 2019, and is headquartered in Mountain View, California, USA, with a workforce of 51-200 employees. Its website is https://thelevel.ai.Company H1B Sponsorship
Level AI has a track record of offering H1B sponsorships, with 1 in 2026, 2 in 2023, 1 in 2022, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.