Senior MLOps Engineer - AI Infrastructure

As a Senior MLOps Engineer, you will be pivotal in designing, implementing, and maintaining our AI cloud infrastructure. You will join a highly technological team responsible for developing our model-serving platform, optimizing inference, and ensuring reliability and cost efficiency. In this role, you will collaborate with key stakeholders across the company, including product engineering teams, internal clients (both researchers and engineers), and Security and DevOps, to automate processes, streamline operations, and drive impactful changes in our model-serving strategy.

Key Responsibilities:

• AI Infrastructure Design & Implementation: Lead the design and implementation of our cloud-native infrastructure, ensuring it is performant, scalable, and cost-effective.
• Automation & Streamlining: Help automate and streamline our AI operations and processes, enhancing efficiency and reducing manual intervention.
• Cross-Functional Collaboration: Work closely with product engineering teams, including internal clients (both researchers and engineers), security, DevOps, and more, to ensure adoption of our AI platform.
• Impactful Contribution: Play a major part in shaping the company’s AI serving strategy, focusing on innovation and long-term success.

Qualifications:

• 4+ years as a DevOps/MLOps Engineer, with extensive experience in cloud computing technologies, preferably AWS.
• Strong scripting and automation skills, ideally using Python and bash.
• Proficiency with Infrastructure as Code (IaC) tools such as Terraform and Terragrunt.
• Hands-on experience with GitOps and CI/CD methodologies and tools like ArgoCD, Argo Workflows, GitHub Actions, and Jenkins.
• Proven experience working with Kubernetes (K8s) in production environments.
• Experienced with common model-serving solutions: Ray/KServe/Triton/HF etc׳.
• Experienced with system observability & monitoring.
• A solid understanding of computer networking fundamentals, storage, REST/gRPC architecture.
• Excellent communication skills and the ability to execute projects from design to implementation.

We operate in a flexible hybrid work model. 

 

What makes the Model-Serving team at Gong unique?

AI is central to Gong's value delivery, and our team sits at the heart of this mission. We bridge research and infrastructure—developing both cutting-edge AI models and the robust serving platform that powers them at scale.

Our focus is building a unified, high-performance AI serving platform that enables seamless deployment from research to production. We're scaling our team to support Gong's rapid evolution into an AI-first company.

 

What makes Engineering at Gong unique? 

Here at Gong, we trust and empower our employees with ownership to solve complex problems, make the right decisions, and build the best products that create radical impact. We call this “Own. Solve. Impact.”  

If you are curious to discover Gong's wonderful and challenging world, what are you waiting for? Don’t delay - fill in your application details. 

Who knows, maybe there’s a Gongster in you!

 

Gong empowers everyone in revenue teams to improve productivity, increase predictability, and drive revenue growth by deeply understanding customers and business trends; driving impactful decisions and actions. The Gong Revenue AI Platform captures and contextualizes customer interactions, surfaces insights and predictions, and powers actions and workflows that are essential for business success. More than 4,500 companies around the world rely on Gong to unlock their revenue potential. For more information, visit www.gong.io.

Gong is an equal-opportunity employer. We believe that diversity is integral to our success, and do not discriminate based on race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, military status, genetic information, or any other basis protected by applicable law.

To review Gong’s privacy policy, visit www.gong.io/privacy-policy for more details.

#LI-IS1