[Remote] Senior AI Product Engineer, Backend

Note: The job is a remote job and is open to candidates in USA. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. The Senior AI Product Engineer, Backend will be part of the core team that drives product innovation, focusing on building scalable backend services and APIs for Machine Learning and LLM workflows.

Responsibilities

• Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
• Build high-volume and highly available analytics systems
• Design and build APIs specific to our customers’ Machine Learning and LLM workflows
• Prototype, optimize, and maintain scalable backend services that power the Arize core platform
• Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks
• Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
• Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment
• Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings
• Contribute to the build our own in-house AI Agents

Skills

• 5+ years of experience working with high-performance backend systems
• Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
• Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
• Previous work building and operating highly complex SaaS platforms/systems
• Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc
• Experience with distributed stream processing - Kafka, Gazette, or similar
• Experience with OLAP systems
• Familiarity with system observability tooling like Prometheus
• Working knowledge of Machine Learning and/or Data Science
• First-hand experience working with large language models (LLMs) or developing AI products

Benefits

• A competitive equity package
• A comprehensive benefits package, including medical, dental, vision
• A 401(k) plan
• Unlimited paid time off
• A generous parental leave plan
• Additional support for mental health and wellness
• WFH monthly stipend to pay for co-working spaces

Company Overview

Arize is an AI engineering platform focused on evaluation and observability. It helps engineers develop, evaluate, and observe AI agents. It was founded in 2020, and is headquartered in Berkeley, California, USA, with a workforce of 51-200 employees. Its website is https://arize.com.

Company H1B Sponsorship

Arize AI has a track record of offering H1B sponsorships, with 1 in 2025, 1 in 2024. Please note that this does not guarantee sponsorship for this specific role.