ML LLM Technical Architect

WE ARE

SoftServe is a global digital solutions company, headquartered in Austin, Texas, and founded in 1993. With 2,000+ active projects across the USA, Europe, APAC, and LATAM, we deliver meaningful outcomes through bold thinking and deep expertise. Our people create impactful solutions, drive innovation, and genuinely enjoy what they do.

The AI and Data Science Center of Excellence (CoE) is SoftServe’s premier AI/ML hub, primarily based in Europe. With 130+ experts, including data scientists, research analysts, MLOps engineers, ML and LLM architects, we cover the full AI lifecycle, from problem framing to deployment.

In 2024, we delivered 150+ AI projects, including over 100 focused on Generative AI, combining scale with measurable impact.

We are a 2024 NVIDIA Service Delivery Partner and maintain strong collaborations 8with Google Cloud, Amazon, and Microsoft, ensuring our teams always work with cutting-edge tools and technologies.

We also lead Gen AI Lab, our internal innovation engine focused on applied research and cross-functional collaboration in Generative AI.

In 2025, a key area of innovation is Agentic AI, where we design and deploy autonomous, collaborative agent systems capable of addressing complex, real-world challenges at scale for our clients and internally.

IF YOU ARE

• Educated with a degree in Computer Science or a related field

• Experienced in a similar position, including 2+ years of design and implementation of enterprise-scale AI/ML solutions in the AWS cloud using services such as Amazon SageMaker, AWS Bedrock, Amazon Kendra, AWS Glue, AWS Data Pipelines, Amazon Kinesis, Amazon Athena, and Amazon Redshift

• Designing sustainable, scalable, and secure architectures, performing trade-off analysis of different architecture tactics and patterns, and applying proven architecture design approaches and methodologies, with a focus on GenAI and LLM-based solutions

• Driving project roll-outs from requirements gathering to go-live and continuous improvement

• Skilled in designing, building, or operationalizing Agentic AI systems, with hands-on experience leveraging frameworks like Amazon -Bedrock Agents to create autonomous and goal-oriented GenAI solutions

• Confident in customer-facing tasks related to discovery, assessment, execution, and operations for complex AI/ML/GenAI projects

• Knowledgeable of EKS/ECS platforms and their design patterns for ML workloads

• Confident upper-intermediate English speaker

• Responsible for AI principles and practices, including model explainability, fairness, and security for GenAI (nice to have)

• Experienced in pre-sales, enterprise consulting, or AI/ML advisory roles (would be a plus)

AND YOU WANT TO

• Engage in a wide scope of AI and ML-related work, from foundational machine learning projects to advanced Generative AI applications

• Bring your deep expertise in cloud architecture, DevOps, and MLOps/LLMOps to analyze and recommend enterprise-grade solutions for operationalizing the full spectrum of AI

• Develop end-to-end MLOps/LLMOps pipelines on AWS, leveraging an in-depth understanding of the platform, the entire AI lifecycle, and business problems to ensure solutions are delivered efficiently, predictably, and sustainably

• Prototype and demonstrate innovative solutions, including proof-of-concepts for diverse AI/ML use cases and specific GenAI applications, for clients in customer environments

• Develop assets, accelerators, and reusable components for your practice, covering both established AI/ML methodologies and emerging GenAI and LLMOps space

• Communicate use cases, technical requirements, architectural decisions, and expectations clearly with stakeholders at all levels

• Guide Engineering and Data Science teams on the production lifecycle of ML systems, including best practices for building, deploying, and monitoring traditional ML models and LLM-powered applications

• Educate Product teams on best practices for putting ML systems, including innovative GenAI features, into production reliably and responsibly

TOGETHER WE WILL

• Operationalize our clients’ AI solutions, from traditional ML to cutting-edge Generative AI applications, by leveraging best practices in Machine Learning, DevOps, LLMOps, and Solution Architecture.

• Maintain synergy among Data Scientists, DevOps teams, and ML Engineers to build robust infrastructure, set up efficient processes, productize machine learning and GenAI pipelines, and integrate them seamlessly into existing business environments.

• Participate in international events, conferences, and workshops to share our expertise and learn from the global AI community.

• Get certifications in cutting-edge technologies and continuously enhance our skills in the dynamic field of AI.

• Drive innovation by exploring and implementing novel AI and GenAI solutions that deliver significant business value for our clients.

• Have the possibility to work with the latest technologies on different projects and internal initiatives

• Communicate with the world-leading companies from our logos portfolio

• Work as a consultant on different projects with a flexible schedule