Software Engineer III Vertex AI Hybrid Cloud

Minimum qualifications:Bachelor’s degree or equivalent practical experience.2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.1 year of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.1 year of experience with Machine Learning (ML) infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).Preferred qualifications:Master's degree or PhD in Computer Science, or a related technical field.2 years of experience with data structures or algorithms.1 year of experience with scaling AI deployments.Experience in deploying AI on Kubernetes clusters.Knowledge of running Large Language Models (LLM) at scale in confidential compute configuration.Understanding of how AI works and the requirements for running AI inference in a cluster.About the jobGoogle's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.Join the Vertex AI team and be at the forefront of bringing Google's AI to our customer's own infrastructure through Google Distributed Cloud.As a Software Engineer in the Vertex AI and Hybrid Cloud team, you will use your expertise in Go and Java to build and manage the platform that delivers the Vertex AI stack to external clouds. You will be responsible for the end-to-end delivery of features that deploy and manage powerful AI models like Gemini for our customers.The Google Cloud AI Research team addresses AI challenges motivated by Google Cloud’s mission of bringing AI to tech, healthcare, finance, retail and many other industries. We work on a range of unique problems focused on research topics that maximize scientific and real-world impact, aiming to push the state-of-the-art in AI and share findings with the broader research community. We also collaborate with product teams to bring innovations to real-world impact that benefits our customers.ResponsibilitiesDeliver end-to-end features for Google Distributed Cloud (GDC) that deploy, manage the Gemini and other models.Deliver code and successfully deploy into production.Build tests for code and automate running those tests if needed.Code components to manage Kubernetes cluster in Golang.Add features to the management plane in Java.Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.