Senior Data Scientist – VoiceAI

VoiceAI builds the real-time voice layer behind Trusting Social's AI agents, for both outbound and inbound calls. We own the cascade pipeline that connects the caller to the agent (ASR → LLM → TTS): real-time speech understanding (ASR), real-time speech generation (TTS), the real-time orchestration between speech and the LLM script, and the interaction behaviour on top, including turn-taking, latency, and answering machine detection. Our platform powers Kompato (AI collections for US fintech lenders) and Sophia (financial services sales in Vietnam and the Philippines), working closely with the Collin and Sophia DS and product teams, who own the LLM dialogue scripts, and the engineering team, who owns telephony and inbound routing and connects to our layer through the same interface for inbound and outbound calls. About the role This is a senior, fully hands-on role. You will own a full area of the VoiceAI platform end to end, such as real-time speech generation, speech understanding, or pipeline orchestration quality. You will solve ambiguous problems independently, set the technical approach for your area, and mentor the people working on it. What you'll do Own a full area of the VoiceAI platform end-to-end, from research and modelling to deployment and production monitoring Drive model development hands-on: TTS post-training and fine-tuning, AMD, end-of-turn detection, and speech model adaptation for Vietnamese, Tagalog, and US English Stay on top of the state of the art in speech understanding, speech generation, and speech-to-speech models (research, open-source releases, and commercial vendors), quickly benchmark what is new, and bring recommendations to the roadmap Design the evaluation methods for your area: offline benchmarks, TTS arenas, audio-based judges, human rating programs, and online A/B testing Own production quality and reliability for your area, with monitoring and alerting that catch regressions before callers hear them Mentor data scientists and engineers, and lead technical reviews Partner with the Collin and Sophia DS and product teams and with engineering; present evidence-first findings and trade-offs to senior stakeholders What we're looking for Hands-on with a full-stack mindset: you own the whole lifecycle, from modelling and engineering to deployment and production monitoring AI-native way of working: you use AI tools (coding agents, LLM assistants) every day to build, analyze, and ship faster Real-time mindset, especially for voice and speech: you design for streaming and low latency by default, think in milliseconds, and care about how every delay and glitch sounds to the caller 5+ years in data science or applied ML, including technical ownership of a production ML system Deep expertise in speech or audio ML (ASR, TTS, VAD, speaker modeling) with models shipped to production Keeps up with SOTA in speech and LLM research and the vendor market, with a sharp sense of what is production-ready versus hype Strong statistics and evaluation fundamentals: experiment design, calibration, error analysis, FPR/FNR trade-offs Fluent in Python and SQL, and comfortable writing and reviewing production code and ML pipelines Clear written communication in English; able to make and defend technical decisions with data Nice to have Experience post-training or fine-tuning large speech or LLM models (SFT, preference optimization, distillation) Hands-on experience with real-time voice stacks (LiveKit, Pipecat) and GPU model serving Background in regulated domains such as lending or debt collection Vietnamese or Tagalog speech data experience What We Offer Join our vibrant team and enjoy: Opportunity to work and learn from one of the best and brightest technology teams in Vietnam Be part of a winning team with exponential growth regionally, experience recruiting world-class talents Competitive compensation package, including 13th-month salary and performance bonuses Comprehensive health care coverage for you and your dependents Generous leave policies, including annual leave, sick leave, and flexible work hours Convenient central district 1 office location, next to a future metro station On-site lunch with multiple options, including vegetarian Grab for work allowance and fully equipped workstations Fun and engaging team-building activities, sponsored sports clubs, and happy hour every Thursday Unlimited free coffee, tea, snacks, and fruit to keep you energized An opportunity to make a social impact by helping to democratize credit access in emerging markets At Trusting Social, we live by ownership, integrity, and agility in execution. We believe in doing what's right, what's best, and what's innovative. If you're smart, driven, and want to make a difference in the world with the most advanced and fascinating technology, come join our team. We offer the runway to truly make an impact. Learn more about us: https://trustingsocial.com | https://www.youtube.com/watch?v=inAEDGvOcL8&t=29s