Note: The job is a remote job and is open to candidates in USA. Xylo Technologies is seeking a Senior Software Engineer for AI Platform Engineering. The role involves designing high-performance hosting environments and building scalable hybrid-cloud infrastructure for AI capabilities, ensuring operational excellence and collaboration with cross-functional teams.
Responsibilities
- Design and implement high-performance hosting environments for both specialized models and autonomous agents
- Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments
- Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production
- Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services
- Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value
Skills
- Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (4+ years of in-depth Kubernetes is a must)
- Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures
- A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments
- The ability to turn abstract AI research into production-grade, hardened platform features
- Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields
- Demonstrated problem solving and time management skills
- Possesses strong technical aptitude for designing and implementing software solutions
- Experience with modern application development frameworks
- Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Deep hands-on technical expertise, excellent verbal and written communication skills
- Experience with Agile software development techniques
- Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience
- Ability to use a wide variety of open-source technologies and cloud-based services
- Experience writing software for hybrid cloud (GCP, AWS, Azure)
- Experience building high-performance, highly available and scalable distributed systems
- Experience developing software for healthcare related industries
Company Overview
Over the past decade, Xylo Technologies has emerged as a leading provider of technology based solutions. It was founded in 2000, and is headquartered in Rochester, Minnesota, USA, with a workforce of 51-200 employees. Its website is https://xylotechnologies.com.Company H1B Sponsorship
Xylo Technologies has a track record of offering H1B sponsorships, with 2 in 2025, 2 in 2024, 1 in 2023, 1 in 2022, 2 in 2021, 9 in 2020. Please note that this does not guarantee sponsorship for this specific role.