Senior System Software Engineer, Speech AI

Responsibilities

• Work on cutting-edge GPU-accelerated AI systems deployed at scale
• Tackle challenging problems in real-time streaming audio processing and low-latency inference
• Troubleshoot and resolve complex issues across ASR, TTS, ALM, and S2S pipelines
• Model Integration: Work alongside Model researchers to transition ASR, TTS and S2S models from research to production readiness.
• Develop Core Speech Services
• Build and enhance C++ & python backend implementations for ASR, TTS, and S2S pipelines, leveraging CUDA for GPU acceleration
• Optimize Inference Performance: Improve streaming latency and throughput through advanced batching strategies, encoder caching, and multi-threaded pipeline optimizations
• Feature Development: Add new capabilities such as advanced voice activity detection, speaker diarization, decoder implementations (CTC, WFST, Flashlight), and text post-processing
• Client Libraries
• Contribute to Python and C++ client SDKs and CLI tools for easy service integration

Languages