Backend Engineer- Inference Services

Company Overview Deepgram is bringing the world’s most natural interface, voice, to the technology we use every day. Our speech models and real-time infrastructure power AI systems that keep up with the way people actually speak. More than 5,000 organizations run conversational voice AI on Deepgram in production, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Cresta, Granola, and Jack in the Box. The Deepgram Voice Agent Platform brings together speech-to-text, text-to-speech and speech-to-speech, with voice-native foundation models available through cloud APIs or self-hosted and on-premises deployments. Built for accuracy, low latency and cost efficiency, Deepgram makes high-quality voice experiences practical to build and run at scale. More than 650,000 developers have used Deepgram to process more than 200,000 years of audio. Every day, more of the world’s conversations with AI run on our models. Operating Principles: Deepgram is a research company that productizes as fast as possible. Four Operating Principles shape how we think, decide, and work together: Compress before you communicate. You think it through first, then lead with the bottom line. Resist entropy. You question what already exists before adding more process or tools. Solve the category. You fix recurring problems at the source, not one case at a time. Work at the frontier. You go after problems no one has solved yet. We look for people who already work this way, and these principles shape how we grow and evaluate our team. AI-First by Default We build AI that millions of people talk to, and we run the company the same way. AI is how we centralize work here, and is core to how we operate. That means more than using the tools. We expect you to: Build, not just use. Design your own workflows and agents, and use AI to remove whole categories of work instead of doing the same work faster. Own the output. AI can speed up the work. It doesn’t make anyone less accountable for it. You understand, verify, and stand behind everything you share, including what an agent produces for you. Spend the time you get back at the frontier. The capacity AI creates goes toward problems no one has solved yet. Keep pace. Models and tools change every month, and so will your work. You adopt what’s new quickly and drop what no longer earns its place. We judge AI by what it helps you deliver and whether you stand behind the result, not by how often you use it. In interviews, expect to walk us through a workflow you built and where you drew the line between AI and your own judgment. Opportunity: Deepgram is looking for a Backend Software Engineer to join the Engine team to lead the design and implementation of Deepgram’s products. You will design and implement secure, robust, and scalable services for speech processing; efficient, distributed compute orchestration; optimized scheduling, and more. Your skill at building highly reusable code that overcomes technical challenges is paired with an intuition for delightful user experiences. You will be a critical voice in Deepgram’s Product and Engineering teams, driving high impact products from start to finish. What You’ll Do Improve Deepgram’s core inference services including areas in networking, speech processing, audio transcoding, and latency and memory optimization Develop processes for measuring, building, and optimizing services to maximize system performance Debug complex system issues that include networking, scheduling, and high performance computing interactions Rapidly customize backend services to support our customer needs Partner with Product to design and implement new services, features, and/or products end to end You’ll Love This Role If You Thrive in a fast-paced, impact-driven environment where learning new skills on-the-fly is not only encouraged but a regular necessity Enjoy balancing decisions about product and feature maturity to decide when to make minimally invasive changes versus when to incorporate detailed design work It’s Important To Us That You Have 3+ years of experience in an industry role Programming experience in Rust (or C, C++), with competence in Python Excellent communication and organizational skills, both written and verbal. A high level of experience and understanding of version control; preferably git. Comprehensive experience with UNIX-style systems. It Would Be Great if You Had Experience with modern machine learning, such as experience with a framework like Torch or implementation knowledge of architectures like CNNs, RNNS, and transformers Experience with audio processing Notice : We're aware of individuals impersonating Deepgram recruiters. All legitimate Deepgram recruiting communication comes from an @ deepgram.com email address. If you've received a message claiming to be Deepgram, please forward it to careers@deepgram.com.