Test Automation Engineer

4 dni temu

Warszawa, Mazovia, Polska Transition Technologies MS Pełny etat

We're searching for a Test Automation Engineer.

Your responsibilities:

  • Generative AI Testing Strategy: Design and implement comprehensive testing strategies specifically tailored for LLM-based applications, including evaluation of model responses, RAG pipelines accuracy, and overall system reliability
  • Quality Assurance Framework Development: Utilize Client's testing frameworks that address both traditional software quality aspects and AI-specific concerns such as output consistency, contextual accuracy, and ethical compliance; co-create and maintain such frameworks when required
  • Test Automation Development: Design and implement automated testing solutions for continuous evaluation of LLM applications, including integration tests, performance tests, and specialized AI behavior tests
  • Edge Case Analysis: Identify and develop test scenarios for edge cases in LLM behavior, including handling of ambiguous inputs, potential biases, and unexpected response patterns
  • Bias and Fairness Testing: Design and execute tests to identify potential biases in model outputs and ensure fair treatment across different user groups and use cases
  • Security Testing: Collaborate within development teams to test for potential vulnerabilities specific to LLM applications, including prompt injection, data leakage, and other AI-specific security concerns
  • Test Documentation: Create and maintain comprehensive test documentation testing strategy, test cases, and testing guidelines specific to AI applications and compliant with Client practices; document the analysis of requirements and risks and develop tests accordingly
  • Performance Testing: Collaborate with other engineers to conduct thorough performance testing of GenAI applications, including response time analysis, load testing, and resource utilization monitoring

We are looking for you, if you have:

  • Experience: 3+ years of experience in software testing, with at least 1 year focused on genAI applications
  • Technical skills: Strong proficiency in Python and testing frameworks (e.g., pytest, unittest); experience with AI testing tools and frameworks
  • AI/ML knowledge: Understanding of LLM architectures, RAG systems, and common failure modes in AI applications; familiarity with evaluation metrics for generative AI
  • Test Automation: Experience with test automation frameworks and CI/CD pipelines; ability to design and implement automated testing solutions for AI applications
  • Ability to analyze requirements, identify test scenarios, and prioritize testing activities based on risk and impact
  • Cloud Platforms: Practical experience with testing applications on cloud platforms (AWS, Azure) and working with cloud-based AI services
  • Monitoring tools: Experience with monitoring and observability tools, log analysis, and performance metrics tracking (e.g. DataDog, Grafana)
  • ALM tools: Experienced in Roche mandatory ALM tools (e.g. Jira, GitLab, ServiceNow)
  • Security Testing: Understanding of security testing methodologies, particularly in the context of AI applications
  • Very good practical and theoretical knowledge of testing processes (ISTQB Advanced, etc.)
  • The successful candidate should also hold B.Sc., B.Eng., M.Sc., M.Eng. in Computer Science, Software Engineering, or equivalent degree with strong background in testing methodologies
  • Be able to communicate in English at the level of C1+

We offer:

  • Participation in interesting and demanding projects
  • Flexible working hours
  • A great, non-corporate atmosphere
  • Stable employment conditions (contract of employment or B2B contract)
  • Opportunity to develop your career

We reserve the right to contact the selected candidates.

  • Lead Test Automation Engineer

    7 dni temu

    Warszawa, Mazovia, Polska OPENNET Pełny etat

    Lead Test Automation EngineerWe are searching for a Lead Test Automation Engineer to spearhead our test automation efforts. The successful candidate will have extensive experience in test automation and a proven track record of delivering high-quality automated tests.The role involves designing and implementing automated testing frameworks, collaborating...

  • Lead Test Automation Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    About Us:We are Square One. For 30 years, we've specialized in IT recruitment, and we know exactly what IT experts like you need. If you're looking for new challenges, aren't afraid of skill-building projects, and want to stay on the technological cutting edge—then you've come to the right placeAbout the Project:Our client, who specializes is web and...

  • Mobile Test Automation Engineer

    5 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    At AgileEngine, we are looking for a talented Mobile Test Automation Engineer to join our team.We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.You will be working with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.The...

  • Test Automation Engineer

    3 dni temu

    Warszawa, Mazovia, Polska Amadeus Pełny etat

    About the RoleWe are looking for a skilled Test Automation Engineer to design and implement automated tests for our software products.As a key member of our QA team, you will be responsible for creating test requirements, developing test plans, and performing testing of our software.You will also be responsible for documenting and tracking test outcomes,...

  • Automation Test Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Automation Test Engineerlokalizacja: Warszawa (mazowieckie)numer referencyjny: 1192080/jobs.plHays IT Contracting is a B2B collaboration. Our company matches IT specialists with the most interesting technology projects on the market. Join the group of 500 satisfied Contractors and work for Hays ClientsCurrently, for our Client, we are looking for Candidates...

  • Software Test Automation Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Software Test Automation Engineerlokalizacja: Warszawa (mazowieckie)numer referencyjny: 1191728/jobs.plforma zatrudnienia: Pełny etatYour new company Join global leader of heavy machinery industry and work in their newly established technological centre. You will become part of a division that is responsible for delivering innovative solutions to help...

  • Test Automation Engineer

    7 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    About Our MissionTN Poland aims to deliver exceptional IT services globally by aligning client needs with employee skills.We strive to create a rewarding experience for each Employee and Consultant. You'll be part of a diverse community that fosters growth and collaboration.Job ResponsibilitiesCollaborate with colleagues to design a robust automated testing...

  • Test Automation Engineer

    3 dni temu

    Warszawa, Mazovia, Polska TeamQuest Sp. z o.o. Pełny etat

    Our client is an innovative company operating in the ICT industry since 2023, specializing in NMS/OSS systems, system platforms, and as a Software House. It offers a wide range of products, from custom IT solutions, commercial solutions, to those based on open-source software, always tailored to the specific needs of the client. The company stands out in the...

  • Test Automation Specialist

    6 dni temu

    Warszawa, Mazovia, Polska Collibra Pełny etat

    About the RoleCollibra is looking for an experienced Quality Assurance Engineer to join our Test Engineering team. As a Quality Assurance Engineer, you will play a crucial role in ensuring the quality of our products by designing, developing, and executing automation scripts and test automation frameworks.You will be working closely with our development...

  • Senior Test Automation Engineer

    4 dni temu

    Warszawa, Mazovia, Polska The Codest Pełny etat

    The Codest is seeking a seasoned Senior Test Automation Engineer to help us deliver high-quality software solutions. As a Technical Tester, you'll play a crucial role in ensuring the success of our banking app project for a leading financial group in Japan.Job OverviewThis is an excellent opportunity for a motivated individual to take their career to the...

  • Automation Test Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Nord Security Pełny etat

    Job DescriptionThe Desktop Applications department at Nord Security is a collaborative team of passionate engineers focused on solving complex problems using C#, .NET, SWIFT, Linux, and macOS technologies.We are looking for an experienced Automation Test Engineer to design, execute, and automate tests for our NordVPN Linux application. You will work closely...

  • Test Automation Engineer

    38 minut temu

    Warszawa, Mazovia, Polska ipracujzdalnie Pełny etat

    Praca na stanowisku: Test Automation EngineerOur client is an innovative company operating in the ICT industry since 2023, specializing in NMS/OSS systems, system platforms, and as a Software House. It offers a wide range of products, from custom IT solutions, commercial solutions, to those based on open-source software, always tailored to the specific needs...

  • Test Automation Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Nord Security Pełny etat

    The Infrastructure department is responsible for influencing and tracking change, providing frontline support, and delivering software-defined solutions.We are seeking a skilled Test Automation Engineer (Python) / Python Developer – Automation & Testing to join our team. The ideal candidate will have strong experience in Python development, automation, and...

  • Test Automation Framework Developer

    2 dni temu

    Warszawa, Mazovia, Polska PARETO SECURITIES AS Pełny etat

    The RoleWe're looking for a talented QA Automation Engineer to join our QA Team in Scoutz. As a QA Automation Engineer, you will be responsible for developing and maintaining our test automation framework, collaborating with cross-functional teams, and ensuring high-quality software releases.Main ResponsibilitiesDevelop and maintain test automation...

  • Lead Test Automation Engineer

    3 godzin temu

    Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

    Axiom Software Solutions Limited is looking for a Lead Test Automation Engineer to join our team and drive the implementation of high-quality test automation solutions.The successful candidate will have a strong background in software development, specifically in Java, Selenium, Cucumber, Playwright, SikuliX and API testing tools such as Postman or REST...

  • Remote Senior Test Automation Engineer

    4 dni temu

    Warszawa, Mazovia, Polska EndySoft Pełny etat

    technologies-expected : Python VMware technologies-optional : about-project : ~ We are seeking a highly skilled Test Automation Engineer to join our team. The ideal candidate will have strong experience in Python programming and test automation across various domains, including web applications, APIs, and virtualization environments. Automate API testing and...

  • Automation Test Engineer Product Development

    6 dni temu

    Warszawa, Mazovia, Polska Consafe Logistics Pełny etat

    Job SummaryWe are looking for a skilled Software Test Engineer to join our Research & Development team. The successful candidate will be responsible for designing and implementing automated tests to ensure the quality of our products.Key ResponsibilitiesDevelop and maintain automated tests using Robot Framework and PlaywrightCollaborate with cross-functional...

  • Senior Test Automation Engineer

    4 dni temu

    Warszawa, Mazovia, Polska EndySoft Pełny etat

    technologies-expected : Python Selenium VMware OpenStack GitLab technologies-optional : Docker Kubernetes about-project : We are seeking a highly skilled Test Automation Engineer to join our team. The ideal candidate will have strong experience in Python programming and test automation across various domains, including web...

  • Test Automation Engineer

    2 dni temu

    Warszawa, Mazovia, Polska ASCENDION ENGINEERING SOLUTIONS POLAND SP. Z O.O. Pełny etat

    About ASCENDION ENGINEERING SOLUTIONS POLAND SP. Z O.O.We are seeking a highly skilled Test Automation Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining automation frameworks using Java, Selenium, Cucumber, and Playwright.Key Responsibilities:Automation Framework Development: Develop and maintain...

  • Senior Software Test Automation Engineer

    13 godzin temu

    Warszawa, Mazovia, Polska ASCENDION ENGINEERING SOLUTIONS POLAND SP. Z O.O. Pełny etat

    Job DescriptionAt ASCENDION ENGINEERING SOLUTIONS POLAND SP. Z O.O., we are seeking a highly skilled Senior Software Test Automation Engineer to join our team.We develop robust automation frameworks using Java, Selenium, Cucumber, and Playwright, along with tools like Postman REST Assured. Our ideal candidate will create reusable, maintainable test scripts...