Automated QA Engineer

1 tydzień temu

Warszawa, mazowieckie, Polska Transition Technologies MS Pełny etat

We are looking for an Automated QA Engineer to join our team who will focus on end-to-end quality assurance.


Your responsibilities:

● RAG Quality Evaluation: Design and curate datasets for RAG evaluation, develop and execute tests for RAG benchmarking, evaluating the accuracy and relevance of AI-generated content and information retrieval.

● Data-Driven Validation: Use data analysis techniques to evaluate test outcomes, track AI performance trends, and detect regression or drift across releases.

● Automation Test Solution Development: Design and implement automated test suites for both OutSystems front-end modules and backend microservices interacting with RaaS from the Galileo platform.

● Regression Testing: Build and maintain automated regression pipelines to ensure continuous platform stability after deployments and LLM-model updates.

● Integration Testing: Verify seamless communication between LUMIN and Galileo APIs, ensuring data integrity and correct processing across layers.

● CI/CD Integration: Embed automated tests into CI/CD pipelines (GitLab CI preferred) to enable consistent, repeatable quality gates before releases.

● Performance & Reliability Testing: Monitor and test system performance and reliability across environments, identifying performance bottlenecks or RAG degradation issues.


We are looking for you, if you have:● Experience: 4+ years of professional experience in automated software testing, including experience with web, API, and backend systems. Strong understanding of regression and integration testing principles. Proven experience in AI-app testing, specifically with applications using LLMs and RAG.

● Automation Skills: Hands-on experience with automated testing tools (e.g., Playwright, Selenium, or OutSystems test automation frameworks). Experience developing custom test scripts in Python or JavaScript/TypeScript.

● AI Quality Testing: Experience testing LLM and RAG applications, including prompt validation, factuality testing, and output benchmarking.

● Backend & API Testing: Proven experience validating RESTful APIs, microservices, and asynchronous workflows. Familiarity with API testing tools (e.g., Postman, pytest, REST Assured).

● CI/CD & DevOps: Working knowledge of GitLab CI or equivalent systems (e.g., Github Actions), with test automation integrated into build pipelines.


We offer:● Interesting and challenging projects

● Flexible working hours

● Friendly, non-corporate atmosphere

● Stable working conditions (CoE or B2B)

● Possibility for self-development and promotion in the company

● Rich benefits package

● Work model: remote or hybrid (2 days per week from the office)

  • QA Engineer ManualAutomation

    4 tygodni temu

    Warszawa, mazowieckie, Polska RITS Professional Services Pełny etat 15 zł - 120 zł

    QA Engineer (Manual+Automat) Najważniejsze InfoTryb pracy: hybryba Warszawa (wizyta w biurze 1-2x w tygodniu) lub zdalnieForma zatrudnienia: B2BPoziom doświadczenia: Mid / SeniorWynagrodzenie (B2B): 90–130 zł/h netto + VAT Preferowana data rozpoczęcia: ASAPCzas trwania projektu: 3 miesiące (z możliwością przedłużenia)System poleceń: Tak Info o...

  • QA Automation Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska FUN CRAFTERS SP. Z O O. Pełny etat

    At Fun Crafters, we're not just another gaming company; we're a passionate community of gaming enthusiasts and innovators with over a decade of expertise in crafting engaging mobile games. With a mission to create unforgettable gaming experiences, we've carved our path in the gaming industry. Join us to unleash your creativity, shape the future of mobile...

  • QA Compliance Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska emagine Polska Pełny etat

    Start: ASAPContract: B2B, 4 monthsWork mode: 100% remoteProject language: EnglishRecruitment process: 2 interviewsSummary:The QA / Compliance Engineer plays a vital role in ensuring that data quality and compliance standards align with SOC 1 requirements, bridging the gap between data quality assurance (QA) and compliance within the...

  • QA Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska Link Group Pełny etat

    We’re looking for an experienced QA Engineer to join our Back Office technology team, responsible for systems supporting post-trade execution, accounting, and investment banking operations. This role involves working on automated testing, with a focus on delivering high-quality, enterprise-grade solutions in a dynamic and highly regulated environment. Your...

  • QA Automation Test Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska Pretius Pełny etat 18 zł - 480 zł

    At Pretius, we are looking for QA Automation Test Engineer to a project for global-scale manufacturing company.Project / RoleDevelop and execute automated test scripts using standard tools and frameworks.Perform API testing to validate the functionality, performance, and reliability of our software.Design, implement, and maintain automated test suites to...

  • Senior QA Automation Engineer Java

    1 tydzień temu

    Warszawa, mazowieckie, Polska Grid Dynamics Poland Pełny etat

    We are looking for an experienced Senior QA Automation Engineer with strong Java skills to join our engineering team. In this role, you will be responsible for designing and maintaining advanced automated testing frameworks, implementing end-to-end, API, and UI test automation, and shaping the overall testing strategy across the application.Essential...

  • Senior QA Automation Engineer

    8 godzin temu

    Warszawa, mazowieckie, mazowieckie, Polska Integral Solutions Pełny etat

    Senior QA Automation EngineerMiejsce pracy: WarszawaTechnologies we useExpectedJavaScriptTypeScriptPlaywrightSQLOptionalPostmanJestSupertestAbout the projectOur client is a rapidly growing gaming/gambling technology startup based in Tel Aviv, Israel, delivering high-performance online entertainment experiences. They are building an exceptional QA team to...

  • QA Automation Test Engineer

    4 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska PRETIUS SOFTWARE SP. Z O.O. Pełny etat

    QA Automation Test EngineerMiejsce pracy: WarszawaTechnologies we useExpectedAutomated TestingPlaywrightJavaScriptCI/CDSeleniumJMeterPostmanOptionalDockerKubernetesAbout the projectAt Pretius, we are looking for QA Automation Test Engineer to a project for global-scale manufacturing company.Your responsibilitiesDevelop and execute automated test scripts...

  • QA Engineer

    1 tydzień temu

    Warszawa, mazowieckie, Polska Jit Team Pełny etat 18 zł - 900 zł

    Remote: Elastic hybrid from Warsaw / Gdynia (1-2 days from the office) Why choose this offer?The international work environment will allow you to interact with the English language dailyThe Jit community will bring you a nice time during regular integration meetings ProjectWe are looking for a skilled Quality Engineer to ensure the quality of products...

  • QA Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska Tooploox Pełny etat 11 zł

    Hi there! We’re Tooploox , a Solvd Inc. company.We create AI-powered products and services that make a real difference. Our team of nearly 200 specialists - including a 40+ person R&D team with many PhDs - has pioneered AI solutions across industries from healthcare to e-commerce. We’ve published research in top-tier venues like NeurIPS and ICML, while...