Note: The job is a remote job and is open to candidates in USA. Cohere is dedicated to scaling intelligence to serve humanity by training and deploying frontier models for AI systems. The Member of Technical Staff will focus on developing and optimizing machine learning algorithms and infrastructure for large-scale, distributed reinforcement learning, while collaborating with various teams to enhance the post-training codebase and support research efforts.
Responsibilities
- Design and write high-performing and scalable software for training models
- Develop new tools to support and accelerate research and LLM training
- Coordinate with other engineering teams (Infrastructure, Efficiency, Serving) and the scientific teams (Agent, Multimodal, Multilingual, etc.) to create a strong and integrated post-training ecosystem
- Craft and implement techniques to improve performance and speed up our training cycles, both on SFT, offline preference, and the RL regime
- Research, implement, and experiment with ideas on our cluster and data infrastructure
- Collaborate, Collaborate, and Collaborate with other scientists, engineers, and teams!
Skills
- Extremely strong software engineering skills
- Value test-driven development methods, clean code, and strive to reduce technical debts at all levels
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR
- Experience using and debugging large-scale distributed training strategies (memory/speed profiling)
- Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray)
- Hands-on experience with the post-training phase of model training, with a strong emphasis on scalability and performance
- Experience in ML, LLM and RL academic research
Benefits
- An open and inclusive culture and work environment
- Work closely with a team on the cutting edge of AI research
- Weekly lunch stipend, in-office lunches & snacks
- Full health and dental benefits, including a separate budget to take care of your mental health
- 100% Parental Leave top-up for up to 6 months
- Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
- Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
- 6 weeks of vacation (30 working days!)
Company Overview