ai evaluation engineer

NVIDIA is seeking senior engineers to pioneer evaluation methodologies for state-of-the-art AI models, including LLMs, vision, and agentic systems. You will build and scale experiments on enterprise-grade GPU clusters to influence model releases and roadmap decisions.Collaborating with model research, training, and product teams, you will design evaluation...

DescriptionPlease submit your CV in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.We're building a dataset to evaluate AI coding agents -...

Software Engineer III, Evaluation Platform Warsaw, Poland What is Box? Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of...

What is Box? Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for...

We are looking for a Senior Data Scientist to join an international project focused on Artificial Intelligence, Large Language Models (LLMs), and AI evaluation.The project focuses on developing and improving methodologies for evaluating the quality and performance of AI models and agentic workflows. The role involves designing...

InPost Group, the team behind Von Halsky, seeks a Technical Lead, Senior AI Engineer to own the Evaluations Platform and guide the next phase of production-grade AI tooling. You will oversee the LLM-judge, curate eval datasets, and drive measurable improvements in conversation quality.You will mentor engineers, define the technical direction, and collaborate...

Mercor partners with a leading AI research lab to support a Frontier Code Agents project. You will help evaluate frontier AI coding models by performing structured assessments on infrastructure tasks and model outputs.The role focuses on real-world engineering workflows, cloud platforms, Kubernetes, and automation. The position requires 2+ years in...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.ResponsibilitiesEvaluate...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. We're building a dataset to evaluate AI coding agents - how well a...

About Finom   Finom is a European tech startup headquartered in Amsterdam, and we’re on a journey towards revolutionizing the financial landscape for entrepreneurs worldwide. Our mission is to develop an all-in-one financial B2B solution that integrates banking functions, accounting, financial management, and invoicing into a seamless, mobile-first...

Rex.zone in Warsaw (Remote) is seeking senior data annotators to create and validate high-quality training data for AI/ML systems. You will support LLM training pipelines through data labeling, QA evaluation, prompt evaluation, and RLHF-style ranking to improve model behavior and evaluation quality.You will annotate NLP, vision, and safety datasets, perform...

NVIDIA Corporation is seeking senior engineers to design evaluation environments for cutting-edge AI models, including LLMs, multimodal systems, and agents. You will build infrastructure, pursue novel evaluation methods, and collaborate with research and product teams to influence model releases.The role emphasizes strong statistical analysis, scalable...

Knowit w Polsce poszukuje Salesforce Marketing Cloud Engineera na poziomie Mid/Senior, który wesprze rozwój skalowalnych rozwiązań marketingowych na globalnej platformie e-commerce.Twoje zadania obejmą projektowanie metryk ewaluacyjnych, tworzenie danych ground truth oraz ocenę trafności wyników i jakości ewaluacji, a także rozwijanie metod ocen z...

Square One Poland is seeking a Senior Data Scientist to join an international project focused on AI, Large Language Models (LLMs), and AI evaluation. You will design evaluation metrics, build ground-truth datasets, analyze model performance, and advance automated and human-feedback-based evaluation approaches.The role emphasizes evaluating AI agents and...

Knowit Connectivity w Polsce poszukuje specjalisty ds. ewaluacji AI do pracy nad oceną jakości systemów AI i metryk ewaluacyjnych. Do zadań należy projektowanie i walidacja metryk, tworzenie zestawów ground truth oraz analiza trafności i błędów.Doświadczenie w ewaluacji AI i modelach LLM będzie kluczowe. Oferujemy pracę w dynamicznym zespole,...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. We're building a dataset to evaluate AI coding agents - how well a...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. We're building a dataset to evaluate AI coding agents - how well a...

InPost seeks a Technical Lead, Senior AI Engineer to own the Evaluations Platform for VonHalsky, InPost's conversational AI assistant. You will define technical direction, mentor engineers, and ensure production-grade evals before features reach users.You will drive the LLM-judge framework, curate real and golden data, and maintain robust diagnostics while...

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an...

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an...