Note: The job is a remote job and is open to candidates in USA. GitHub is the world’s leading platform for agentic software development, and they are seeking a Principal Engineering Manager to lead the development of the GitHub Copilot AI inference platform. This role involves overseeing the allocation and deployment of GitHub's AI resources, managing high-throughput service infrastructure for inference workloads, and improving the experiment-to-production pipeline.
Responsibilities
- Drive and support technical roadmap that aligns with product goals, ensuring that engineering efforts are strategically prioritized and incorporating the adoption of new technologies and methodologies where applicable
- Facilitate cross-team communications, identify dependencies, and resolve conflicts to ensure seamless integration and support across products, applications, and services
- Drive employee growth and development, manage performance, and ensure the engineering team's skills remain current by staying abreast of industry developments and best practices
- Oversee capacity planning and dynamic traffic shaping to ensure performance, reliability, and compliance
- Guide teams in designing scalable, secure, and observable systems that meet business and technical requirements
- Champion experimentation and telemetry-driven development, enabling rapid iteration and data-informed decisions
- Drive engineering excellence through automation, tooling, and standardization across deployment, testing, and operations
- Own incident response and reliability practices, ensuring live services meet SLOs and postmortems drive systemic improvements
- Work with architects to shape GitHub’s long-term vision for AI infrastructure, identifying opportunities for innovation and leading initiatives that scale globally
Skills
- 11+ years' experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python
- + OR Associate's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 10+ years' experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python
- + OR Bachelor's Degree in Computer Science or related field AND 9+ years' experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python
- + OR Master's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 7+ years' experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python
- + OR PhD in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 5+ years' experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python
- + OR equivalent experience
- 5+ years people management experience
- Deep understanding of distributed systems performance, including autoscaling, load balancing, and traffic shaping for inference workloads
- Proven track record of building and scaling engineering organizations in high-growth or ambiguous environments
Benefits
- Annual bonus
- Stock
- Opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role
- Generous learning and growth opportunities
- Excellent benefits to support you, wherever you are
Company Overview
INDRA is a software innovation and development team from National Institute of Technology, Tiruchirappalli specializing in machine learning and artificial intelligence. It was founded in 2017, and is headquartered in Tiruchirappalli, Tamil Nadu, IN, with a workforce of 11-50 employees. Its website is https://github.com/Team-INDRA.Company H1B Sponsorship
INDRA has a track record of offering H1B sponsorships, with 1 in 2025, 2 in 2020. Please note that this does not guarantee sponsorship for this specific role.