QA Engineer

QA Engineer (AI/LLM)

Miejsce pracy: Warszawa

Technologies we use

Expected

- SQL

Optional

- Microsoft Power BI

About the project

We’re looking for a QA Tester with strong AI literacy and data validation skills to test how AI agents behave and ensure that their outputs are stored accurately and reliably in backend systems. This is a manual, exploratory testing role - ideal for someone who can combine curiosity about AI behavior with practical knowledge of data flows, relational databases, and result traceability.

You won’t be writing automation scripts, but you will need to understand how AI agents operate, how their outputs are used, and how to verify correctness across both the UI and backend.

Your responsibilities

- Manually test AI-driven workflows that generate content, complete tasks, or make decisions
- Assess AI behavior by checking for: Consistency and repeatability; Hallucinations, inaccuracy, or bias; Relevance and task alignment
- Evaluate data integrity: Trace AI-generated data from interface to backend; Use SQL to validate how outputs are stored, structured, or logged; Compare AI intent/output to resulting records in the database
- Reproduce and report subtle, fuzzy, or probabilistic issues with structured documentation
- Collaborate with engineers, AI designers, and product owners to define quality criteria across system layers

Our requirements

- 2+ years of manual QA experience, ideally in exploratory or context-driven testing environments
- Practical understanding of LLMs and AI tools (ChatGPT, Claude, etc.)
- Basic to intermediate knowledge of SQL (joins, filters, aggregations, subqueries)
- Experience validating data pipelines, audit logs, or relational integrity
- Able to detect both UI anomalies and backend data discrepancies
- Clear written and verbal communication for reporting behavior-based bugs
- Familiarity with testing non-deterministic or AI-powered systems

Optional

- Understanding of prompt engineering and how LLM behavior can shift with input changes
- Familiarity with AI agent architectures (e.g., LangChain, ReAct, RAG systems)
- Experience working with BI tools (e.g., Metabase, Redash) or data validation frameworks
- Background in content moderation, safety testing, or AI/UX evaluation

This is how we organize our work

This is how we work

- scrum

Team members

- manual tester

This is how we work on a project

- functional tests
- integration tests
- performance tests
- regression tests
- unit tests
- manual tests

What we offer

- Salary: 12 000 - 15 000 PLN net/month (B2B contract, depending on experience)
- Work-life balance: flexible working hours and a hybrid home office model (2 times per week in the office)
- Semi-annual evaluation, transparent career growth planning, and development guidance
- Buddy program for ongoing support
- Training budget accessible after onboarding period
- Fitness card (Benefit Multisport)
- Private health care (EnelMed)
- An open and casual company culture filled with internal events.
- The opportunity to quickly develop professionally on projects in Europe and all over the world
- Great integration events :)
- Referral Program

Benefits

- sharing the costs of sports activities
- private medical care
- sharing the costs of professional training & courses
- access to language learning platform eTutor

Recruitment stages

- Interview with recruiter (30 minutes, MS Teams)
- 60-minutes technical interview on Teams
- Open Day - Meeting at our office (will last about 2 hours)
- 3-month trial period

DPDgroup IT Solutions sp. z o.o.

We are part of Geopost – the largest parcel delivery network in Europe.

DPDgroup IT Solutions was founded in Poland in 2018. We deliver solutions to support the global IT and Tech operations of Geopost.

Today, with a Team of 180+ specialists we take part in ambitious projects, all around the world.

We hire top experts in software delivery, project management, analysis, testing, and support. Thus, we have assembled a fantastic and diverse IT Team that is able to deliver outstanding results and face any challenges.

Administratorem Twoich danych osobowych przetwarzanych w związku z procesem rekrutacji jest DPDgroup IT Solutions sp. z o.o. z siedzibą w Warszawie, ul. Iłżecka 26, 02-135 Warszawa. Spółka wpisana do rejestru przedsiębiorców w Sądzie Rejonowym dla m. st. Warszawy, XIV Wydział Gospodarczy Krajowego Rejestru Sądowego KRS nr 0000713060, NIP: 522-311-01-36, REGON: 369225658, kapitał zakładowy: 31.005.000 PLN

W kwestiach związanych z przetwarzaniem Twoich danych osobowych możesz się z nami skontaktować za pośrednictwem adresu e mail: dgitspl.privacy@dpdgroup.com lub w formie tradycyjnej korespondencji pocztowej wysłanej na adres podany powyżej.