Praca dla evaluation w Warszawa

About the work We're building a high-quality dataset of human preference judgments on AI-generated frontend code. Each task hands you a reference web page - crawled from the real internet, delivered as a full zipped site tree plus screenshots of its default view and, on some pages, additional states reached by hovering, clicking, or scrolling. Alongside it...

About the work We're building a high-quality dataset of human preference judgments on AI-generated frontend code. Each task hands you a reference web page - crawled from the real internet, delivered as a full zipped site tree plus screenshots of its default view and, on some pages, additional states reached by hovering, clicking, or scrolling. Alongside it...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.ResponsibilitiesEvaluate...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.ResponsibilitiesEvaluate...

Software Engineer III, Evaluation Platform Warsaw, Poland What is Box? Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of...

SQUARE ONE RESOURCES sp. z o.o. poszukuje Senior Data Scientist do międzynarodowego projektu z zakresu sztucznej inteligencji, LLM i oceny systemów. Do zadań należy projektowanie metryk oceny, budowa zestawów ground-truth oraz analiza wydajności modeli i przepływów agentowych.Wyjątkowe umiejętności obejmują projektowanie metryk, analizę...

Nasze wymagania:Proven experience as a Senior Data Scientist or in a similar role.Strong data science, statistical analysis, and experimentation skills.Hands-on experience with AI/LLM evaluation.Strong understanding of LLMs and agentic workflows.Experience designing, validating, and optimizing evaluation metrics for AI/ML models.Strong analytical skills and...

Mercor partners with a leading AI research lab to support a Frontier Code Agents project. You will help evaluate frontier AI coding models by performing structured assessments on infrastructure tasks and model outputs.The role focuses on real-world engineering workflows, cloud platforms, Kubernetes, and automation. The position requires 2+ years in...

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an...

Mercor is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.Responsibilities include evaluating outputs for safety,...

The International Research Team (IRT) at Ecorys Poland is seeking a highly motivated Senior Consultant or Lead Consultant with in-depth knowledge of the Ukrainian context, its institutions, stakeholders, and socio-economic context, combined with strong analytical, research, and proposal-writing skills to develop and expand our project portfolio. We are...

NVIDIA is seeking senior engineers to pioneer evaluation methodologies for state-of-the-art AI models, including LLMs, vision, and agentic systems. You will build and scale experiments on enterprise-grade GPU clusters to influence model releases and roadmap decisions.Collaborating with model research, training, and product teams, you will design evaluation...

Rex.zone in Warsaw (Remote) is seeking senior data annotators to create and validate high-quality training data for AI/ML systems. You will support LLM training pipelines through data labeling, QA evaluation, prompt evaluation, and RLHF-style ranking to improve model behavior and evaluation quality.You will annotate NLP, vision, and safety datasets, perform...

We are looking for Generative Audio Evaluation Specialists! A great entry point into ongoing work within one of our most active AI markets! Job Type: Freelance Location: Remote (Poland) Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want! Rate: 11USD/hour Help Shape the Future of AI We’re currently hiring AI Generalists to...

Medison is a global pharmaceutical company providing access to highly innovative therapies to patients in international markets, including EPM. Medison is the first to create an international commercialization platform for highly innovative therapies, helping to save and improve lives by making the novel treatments accessible to patients in the countries we...

We are seeking an innovative Senior Software Engineer specializing in ML Ops for one of our clients, a globally recognized financial enterprise. This is a highly specialized role embedded within a pioneering cybersecurity initiative. You will bridge the gap between software engineering, data science, and security by developing solutions that evaluate...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback. Responsibilities Evaluate...

We are looking for a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform, a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The role includes standardizing agent development across the organization, implementing advanced...

EPAM Systems, Inc. is seeking a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform. You will standardize agent development, implement advanced evaluation frameworks, and create robust CI/CD gates to ensure security and quality.The role emphasizes Python expertise, LLM evaluation, and cloud infrastructure...

Описание:EPAM develops enterprise software products, open source solutions, and accelerators.Задачи:Industrialize AI prototypes into production services on Azure AI Foundry and Azure OpenAI; Build agentic systems using orchestration frameworks, RAG pipelines, vector databases, knowledge graphs, and MCP-based tool integration; Establish...