Senior Engineering Manager

Senior Engineering Manager Miejsce pracy: Kraków Technologies we use Expected TensorRT vLLM TorchServe Triton Operating system Linux About the project The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We build AI platforms for efficient, compliant, and high-performing applications. These platforms support customers in running inference models and empower developers to create advanced AI solutions effectively. AIC As a Senior Engineering Manager, you will oversee and establish a high-performing team of platform and ML engineers. Your team will create a global AI inference platform, offering OpenAI-compatible endpoints and managing workloads across regions. This leadership role requires relevant experience, technical expertise, architectural insights on AI platforms, and a proven track record in delivering AI/ML products at scale. Your responsibilities Building and scaling a world-class engineering team from the ground up, recruiting top talent in AI infrastructure and ML operations. Leading the technical strategy for a global AI inference platform that is performant, compliant, economical, and explainable. Ensuring availability, performance, scalability, and security within the Akamai Inference Cloud environment. Designing global traffic orchestration for AI workloads and establishing platform standards and blueprints for production-grade AI applications. Evaluating AI tools thoroughly while ensuring platform adherence to FedRAMP, GDPR, SOX, and various other regulatory standards. Our requirements Have relevant experience with a track record of building and scaling high-performing engineering teams that shipped successful AI/ML products. Bring hands-on experience with AI inference optimization, model serving, and LLM deployment at scale with deep knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton). Implement containerization strategies for AI workloads, optimize hardware-specific processes, and demonstrate expertise in cloud-native technologies like Kubernetes and distributed systems globally. Demonstrate expertise in building highly available, low-latency platforms with strict SLOs and cost optimization strategies for compute-intensive AI workloads. Have experience with AI application platforms (RAG, agents, fine-tuning). Possess knowledge of AI safety and explainability frameworks. Show familiarity with GPU infrastructure and hardware acceleration. What we offer At Akamai, we will provide you with opportunities to grow, flourish, and achieve great things. Our benefit options are designed to meet your individual needs for today and in the future. We provide benefits surrounding all aspects of your life: •Your health •Your finances •Your family •Your time at work •Your time pursuing other endeavors Our benefit plan options are designed to meet your individual needs and budget, both today and in the future. Benefits sharing the costs of sports activities private medical care life insurance remote work opportunities corporate gym Work in a way that works for you FlexBase, Akamai's Global Flexible Working Program, is based on the principles that are helping us create the best workplace in the world. When our colleagues said that flexible working was important to them, we listened. We also know flexible working is important to many of the incredible people considering joining Akamai. FlexBase, gives 95% of employees the choice to work from their home, their office, or both (in the country advertised). This permanent workplace flexibility program is consistent and fair globally, to help us find incredible talent, virtually anywhere. We are happy to discuss working options for this role and encourage you to speak with your recruiter in more detail when you apply. Working for you At Akamai, we will provide you with opportunities to grow, flourish, and achieve great things. Our benefit options are designed to meet your individual needs for today and in the future. We provide benefits surrounding all aspects of your life: •Your health •Your finances •Your family •Your time at work •Your time pursuing other endeavors Our benefit plan options are designed to meet your individual needs and budget, both today and in the future. Are you seeking an opportunity to make a real difference in a company with a global reach and exciting services and clients? Come join us and grow with a team of people who will energize and inspire you Akamai Technologies Akamai powers and protects life online. Leading companies worldwide choose Akamai to build, deliver, and secure their digital experiences helping billions of people live, work, and play every day. With the world's most distributed compute platform from cloud to edge we make it easy for customers to develop and run applications, while we keep experiences closer to users and threats farther away. I agree to the processing of all my personal data provided during this recruitment process to Akamai Technologies Poland Sp. z o.o. with registered office at Opolska 100, 31-323 Kraków for the purpose of any future recruitment processes conducted by Akamai. More information regarding Akamai's policies and procedures for processing of personal data during the recruitment processes, including on how to withdraw your consent or contact us, is available in the Akamai Privacy Statement (https://www.akamai.com/us/en/multimedia/documents/akamai/akamai-privacy-statement.pdf ).