Highly Skilled Software Testing Professional

3 dni temu


Warszawa, Mazovia, Polska Transition Technologies MS Pełny etat
Job Description

We are searching for a skilled Test Automation Engineer to join our team at Transition Technologies MS.

Responsibilities:
  • Comprehensive Testing Strategies: Design and implement comprehensive testing strategies tailored for LLM-based applications, including evaluation of model responses, RAG pipelines accuracy, and overall system reliability.
  • Quality Assurance Framework Development: Utilize Client's testing frameworks addressing traditional software quality aspects and AI-specific concerns such as output consistency, contextual accuracy, and ethical compliance; co-create and maintain such frameworks when required.
  • Automated Testing Solutions: Design and implement automated testing solutions for continuous evaluation of LLM applications, including integration tests, performance tests, and specialized AI behavior tests.
  • Edge Case Analysis: Identify and develop test scenarios for edge cases in LLM behavior, including handling of ambiguous inputs, potential biases, and unexpected response patterns.
  • Bias and Fairness Testing: Design and execute tests to identify potential biases in model outputs and ensure fair treatment across different user groups and use cases.
  • Security Testing: Collaborate within development teams to test for potential vulnerabilities specific to LLM applications, including prompt injection, data leakage, and other AI-specific security concerns.
  • Test Documentation: Create and maintain comprehensive test documentation testing strategy, test cases, and testing guidelines specific to AI applications and compliant with Client practices; document the analysis of requirements and risks and develop tests accordingly.
  • Performance Testing: Collaborate with other engineers to conduct thorough performance testing of GenAI applications, including response time analysis, load testing, and resource utilization monitoring.
Requirements:
  • Experience: 3+ years of experience in software testing, with at least 1 year focused on genAI applications.
  • Technical skills: Strong proficiency in Python and testing frameworks (e.g., pytest, unittest); experience with AI testing tools and frameworks.
  • Ai/ml knowledge: Understanding of LLM architectures, RAG systems, and common failure modes in AI applications; familiarity with evaluation metrics for generative AI.
  • Test automation: Experience with test automation frameworks and CI/CD pipelines; ability to design and implement automated testing solutions for AI applications.
  • Ability to analyze requirements, identify test scenarios, and prioritize testing activities based on risk and impact.
  • Cloud platforms: Practical experience with testing applications on cloud platforms (AWS, Azure) and working with cloud-based AI services.
  • Monitoring tools: Experience with monitoring and observability tools, log analysis, and performance metrics tracking (e.g. DataDog, Grafana).
  • Alm tools: Experienced in Roche mandatory ALM tools (e.g. Jira, GitLab, ServiceNow).
  • Security testing: Understanding of security testing methodologies, particularly in the context of AI applications.
  • Very good practical and theoretical knowledge of testing processes (ISTQB Advanced, etc.).
  • The successful candidate should also hold B.Sc., B.Eng., M.Sc., M.Eng. in Computer Science, Software Engineering, or equivalent degree with strong background in testing methodologies.
  • Be able to communicate in English at the level of C1+


  • Warszawa, Mazovia, Polska Infinity Quest Pełny etat

    We are Infinity Quest, a leading provider of software solutions that cater to the needs of the banking industry.We are seeking a skilled Functional Testing Professional to join our team. In this role, you will be responsible for designing and implementing automated testing solutions using Java, Selenium, WebDriverIO, Playwright, and Cypress.As a Functional...


  • Warszawa, Mazovia, Polska KPMG Pełny etat

    OverviewKPMG is seeking a highly skilled QA automation professional to join our team. With a focus on delivering high-quality applications, this role requires expertise in test automation development using C# and Selenium.Job DescriptionThis senior QA automation engineer position involves developing and executing automated tests to ensure the quality and...


  • Warszawa, Mazovia, Polska Link Group Pełny etat

    We are seeking a highly skilled performance and test automation expert to join our team at Link Group. As a Senior Performance and Test Automation Engineer, you will play a pivotal role in driving test automation and ensuring the highest quality of our software solutions.Key Responsibilities:Collaborate with our team on testing and implementation activities,...


  • Warszawa, Mazovia, Polska Grohe AG Pełny etat

    Grohe AG is a leader in the global sanitary market. We are seeking a highly skilled SAP ABAP developer to support our technical applications (EWM/TM). The ideal candidate will have more than 6 years of experience with SAP ECC 6.0 or SAP S/4 HANA ERP systems.Main Responsibilities:Develop interfaces, reports, forms, conversion programs, and enhancements based...


  • Warszawa, Mazovia, Polska Luxoft Pełny etat

    Senior Test Analyst and Automation Engineer Job RoleWe are seeking a highly skilled Senior Test Analyst and Automation Engineer to join our team at Luxoft. As a key member of our quality assurance team, you will be responsible for designing and implementing efficient testing strategies and ensuring the highest quality of our software applications.Main...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    TN Poland is seeking a skilled Software Testing Expert to join our team. As a Software Testing Expert, you will be responsible for testing and evaluating software applications to ensure they meet the required standards of quality.The ideal candidate will have a strong background in software testing and development. You will work closely with our development...


  • Warszawa, Mazovia, Polska Visa Inc. Pełny etat

    We're looking for a Highly Skilled IT Consultant to join our Technical Solutions team at Visa Inc.The ideal candidate will have a proven track record of delivering exceptional customer experiences and driving business growth through innovative solutions.Responsibilities:Provide technical support to clients via phone, email, and chat, ensuring high levels of...


  • Warszawa, Mazovia, Polska NATEK Pełny etat

    Welcome to NATEK, a leading company in the e-mobility and energy sector. We are dedicated to accelerating positive change and transformation by enabling businesses with innovative software solutions.Our MissionWe develop a SaaS product that helps companies manage their EV charging infrastructure, processes, and efficient energy use. Our team is highly...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    About us: TN Poland offers a great opportunity for career growth and personal development. We are committed to finding the perfect fit for our team.eHealth solutions for hospitals project involves:Development of eHealth solutionsWorking with hospitals to implement solutionsWe are looking for a highly skilled developer with:At least 6 years of experience in...


  • Warszawa, Mazovia, Polska Crystal Intelligence Pełny etat

    Crystal Team Member:We are seeking a skilled Junior QA Automation Engineer to join the Crystal team. In this role, you will work closely with software engineers to ensure high-quality software products.Key Responsibilities:Designing and implementing automated tests.Maintaining existing automated test suites.Preparing data for automated tests.Collaborating...


  • Warszawa, Mazovia, Polska Aristocrat Interactive Pełny etat

    Aristocrat Interactive seeks a highly motivated Manual QA Engineer to join its dynamic team in Krakow or Warsaw. As a key member of the team, you will play a crucial role in ensuring the high quality of our mobile and web games. Your primary responsibilities will include testing, designing, and collaborating with cross-functional teams to deliver exceptional...


  • Warszawa, Mazovia, Polska Testroniclabs Pełny etat

    We are seeking a highly skilled Multilingual Game Testing Professional to join our Localization Quality Assurance department at Testroniclabs. As a key member of our team, you will play a critical role in ensuring the highest quality of our games.About the Role:You will be responsible for evaluating the accuracy and quality of translated game content.Ensure...


  • Warszawa, Mazovia, Polska Dell Pełny etat

    Key ResponsibilitiesDesign and develop software solutions using Python, Java, and Linux.Collaborate with architects and engineers to build a cohesive architecture.Develop REST API definitions and produce or enhance existing service tools.Work as part of an Agile scrum team in a continuous integration and continuous development environment.


  • Warszawa, Mazovia, Polska PARETO SECURITIES AS Pełny etat

    Creating Digital Solutions for BankingBEC is a pioneering financial technology company providing cutting-edge IT solutions for Danish banks. We facilitate seamless transactions, investments, and loan services for their customers.With a global presence of over 1,700 employees across five locations in Denmark and Poland, we foster a collaborative culture built...


  • Warszawa, Mazovia, Polska Astek Pełny etat

    Astek is seeking a skilled Test Engineer to contribute to the success of our software development projects. As a member of our QA team, you'll be responsible for ensuring the quality and reliability of our products.About UsWe're a global leader in engineering and technology consulting, with a strong presence on five continents. Our company has been gathering...

  • AI Testing Engineer

    5 dni temu


    Warszawa, Mazovia, Polska Transition Technologies MS Pełny etat

    We're looking for a highly skilled AI Testing Engineer to join our team at Transition Technologies MS.Job DescriptionThe ideal candidate will have 3+ years of experience in software testing, with a strong focus on genAI applications. They should possess excellent technical skills in Python and testing frameworks (e.g., pytest, unittest), as well as...


  • Warszawa, Mazovia, Polska Capco Poland Pełny etat

    We are seeking an expert in software development to join our team at Capco Poland. The ideal candidate will have a strong background in Java and experience with microservices architecture.Capco is a global management and technology consultancy that has been delivering business consulting, digital transformation, and technology services for over 25 years. We...


  • Warszawa, Mazovia, Polska careersinpoland Pełny etat

    We are seeking an organized and proactive individual to join our team as a Film Industry Quality Assurance Specialist.As a member of our team, you will be responsible for performing disc/platform testing for various clients, adhering to company security procedures and escalating perceived breaches to QA Coordinator.You will attend monthly mentoring and...


  • Warszawa, Mazovia, Polska Wipro Technologies Pełny etat

    About the RoleWe are looking for a skilled Software Engineering Professional who can design, test, and maintain software programs for operating systems or applications. This role involves working closely with cross-functional teams to deliver high-quality software solutions.Key ResponsibilitiesDesign and DevelopmentDevelop software solutions by studying...


  • Warszawa, Mazovia, Polska LeoVegas Group Pełny etat

    About the RoleWe are seeking a talented Backend Engineer to join our sportsbook domain team.This is an excellent opportunity for a software professional who wants to work on challenging projects, collaborate with a dynamic team, and contribute to the development of cutting-edge technology solutions.You will be responsible for designing, developing, and...