Research Engineer/Research Scientist, Pre-training

Responsibilities

• Conduct research and implement solutions in areas such as model architecture, algorithms, data processing, and optimizer development
• Independently lead small research projects while collaborating with team members on larger initiatives
• Design, run, and analyze scientific experiments to advance our understanding of large language models
• Optimize and scale our training infrastructure to improve efficiency and reliability
• Develop and improve dev tooling to enhance team productivity
• Contribute to the entire stack, from low-level optimizations to high-level model design

Languages