freelance agent evaluation engineer

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. We're building a dataset to evaluate AI coding agents - how well a...

We are looking for a Senior ML / Evaluation Engineer to help define and implement quality standards for enterprise-grade AI agents and LLM-powered applications. In this role, you will design evaluation frameworks, build custom evaluation pipelines, and establish automated quality gates across the AI delivery lifecycle. You will work closely with AI Platform...

Software Engineer III, Evaluation Platform Warsaw, Poland What is Box? Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of...

Job Location WARSAW PLANT & GO Job Description As a Senior AI Agent Engineer, you will build the next generation of agentic AI applications that power P&G's creative content generation platform. Working within the Integrated Creative Solutions (ICS) team, you will design and develop autonomous AI agents that orchestrate multi-modal large language models to...

In short If you're a Senior QA Engineer who's tested apps that talk to physical devices, and you know that "reproduce on my phone" doesn't end the conversation, we want to talk. You'd join us on a freelance, time & material basis: you're paid for the hours you actually work on real client projects. The first three months are about figuring out if we're a...

As a Senior AI Agent Engineer, you will build the next generation of agentic AI applications that power P&G's creative content generation platform. Working within the Integrated Creative Solutions (ICS) team, you will design and develop autonomous AI agents that orchestrate multi-modal large language models to generate, evaluate, and refine marketing images,...

ActiveCampaign is seeking a Software Engineer to join our Kraków Hub and build production-ready AI agents for autonomous marketing. Our platform empowers businesses to automate their customer engagement — and we are now extending that with intelligent, agentic workflows that can reason, act, and adapt on behalf of our customers. Our first wave of agents...

In shortIf you're a firmware engineer who's just as comfortable reading a schematic as writing C, and you've spent serious time inside ESP32 or STM32 projects, we want to talk. You'd join us on a freelance, time & material basis: you're paid for the hours you actually work on real client projects. The first three months are about figuring out if we're a good...

A leading software company in Kraków seeks an experienced Software Engineer to design and build AI agents for autonomous marketing. The role involves developing production-grade workflows and collaborating with multiple teams. Candidates should have solid experience in Python, agent evaluation, and ideally some familiarity with PHP. The company offers a...

Procter & Gamble is seeking a Senior AI Agent Engineer to build autonomous AI agents that orchestrate multi-modal models for creative content generation. You will design pipelines, implement evaluation frameworks, and integrate agents with enterprise APIs, databases, and cloud services.The role emphasizes hands-on development, collaboration with senior...

What We're Looking For Role Overview: We are developing Ask Seeking Alpha — a high-load financial analysis system based on Large Language Models. The architecture is built on complex multi-agent orchestration using LangGraph, FastAPI, and Elasticsearch. We are looking for a Senior Backend Engineer specialized in Generative AI to design agent workflows,...

ActiveCampaign is seeking a Software Engineer to join our Kraków Hub and build production-ready AI agents for autonomous marketing. Our platform empowers businesses to automate their customer engagement - and we are now extending that with intelligent, agentic workflows that can reason, act, and adapt on behalf of our customers. Our first wave of agents is...

Netguru is a trusted partner in digital commerce. The company helps leading brands modernize B2B solutions, marketplaces, and retail ecosystems. Since 2008, it has empowered businesses with cutting-edge technology, AI-powered personalization, and world-class engineering and design teams. A certified B Corporation®, Netguru is trusted by major brands...

Delve Deeper is seeking an experienced, dedicated engineer to build and maintain a multi-agent AI system that automates performance media trading decisions. This is a specialized role in a complex codebase where data quality determines client outcomes and strict evaluation protocols govern every change.You will own agents end-to-end, integrate data across...

We're seeking a Senior AI QA Test Automation Engineer to take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock AgentCore-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs, deposit-status queries, and human handoff. You will design and build the evaluation and QA...

Join a Company That Invests In You Seeking Alpha is the world’s leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re...

Application and Integration Architect (Freelance only)Company DescriptionAre you ready to shape the future technological landscape in Europe?We are dedicated to responsible digitalisation, building innovative, inclusive solutions that drive meaningful impact. With over 8,900 professionals across Europe, we help EU institutions, public and private...

Netguru is a trusted partner in digital commerce. The company helps leading brands modernize B2B solutions, marketplaces, and retail ecosystems. Since 2008, it has empowered businesses with cutting-edge technology, AI-powered personalization, and world-class engineering and design teams. A certified B Corporation®, Netguru is trusted by major brands...

Share Senior Staff Software Engineer, AI Agent Platform, Vertex corporate_fare Google place Warsaw, Poland Bachelor’s degree or equivalent practical experience. 8 years of experience in software development. 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation,...

EPAM Systems, Inc. is seeking a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform. You will standardize agent development, implement advanced evaluation frameworks, and create robust CI/CD gates to ensure security and quality.The role emphasizes Python expertise, LLM evaluation, and cloud infrastructure...