Big Data Engineer

2 tygodni temu


Warszawa, Mazovia, Polska RTB House Pełny etat

We are looking for a highly skilled Data Engineer to join our team at RTB House. As a key member of our data processing platform, you will play a crucial role in building and expanding our real-time data processing capabilities.

Your Responsibilities:

  • Design and develop distributed systems for processing large amounts of data in real-time.
  • Optimize the performance and efficiency of our data processing software.
  • Ensure the reliability and scalability of our solutions.
  • Develop performance and correctness tests for new system components.
  • Stay up-to-date with the latest technologies and their applicability in production conditions.

Our Technology Stack:

  • Java and Python programming languages.
  • Hadoop, Kafka, Kafka Streams, Flume, and Logstash.
  • Docker, Jenkins, and Graphite.
  • Aerospike and PostgreSQL databases.
  • Google Big Query and Elastic search.

Recent Challenges:

  • Replacing the data processing framework with Kafka Streams.
  • Creating a data stream merger using the Kafka Client API.
  • Developing a user profile synchronizer between DCs with Kafka Streams.
  • Implementing a component for calculating aggregates with the Kafka Client API and Bloom filters.
  • Transitioning from Flume and Solr to Logstash and Elastic.

We Offer:

  • A competitive salary.
  • The opportunity to work with a team of enthusiasts who share their knowledge and experience.
  • Flexible cooperation conditions, including remote work.
  • Access to the latest technologies for practical use in a large-scale project.

Learn more about our tech blog: http://techblog.rtbhouse.com/jobs/


  • Data Engineer

    4 tygodni temu


    Warszawa, Mazovia, Polska Jit Team Pełny etat

    Job Title: Data Engineer - Junior Big Data SpecialistJob Summary:We are seeking a highly motivated and detail-oriented Data Engineer to join our team as a Junior Big Data Specialist. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement ETL...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, Mazovia, Polska ITDS Polska Sp. Z O.o. Pełny etat

    Job Summary: We are seeking a highly skilled Senior Data Engineer to join our team at ITDS Polska Sp. Z O.o. As a Senior Data Engineer, you will be responsible for designing, developing, and supporting data engineering solutions for our clients in the life sciences industry.About the Role: As a Senior Data Engineer, you will work collaboratively with our...

  • Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Jit Team Pełny etat

    Job DescriptionAs a Junior Big Data Engineer at Jit Team, you will be part of a dynamic team working on various projects, including providing first-level support and technical expertise to the DROC team.Key Responsibilities:Executing ETL processes and refreshing UIs for data validationAssisting with Spark/Hive queries for dataset analysisClassifying and...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Warsaw. As a Senior Big Data Engineer, you will be responsible for providing first-level support and technical expertise to our DROC team.Key Responsibilities:

  • Senior Big Data Engineer

    3 tygodni temu


    Warszawa, Mazovia, Polska Sanoma Pełny etat

    Establishing the Future of EducationSanoma Learning, a leading European learning company, is seeking a highly skilled Kafka Engineer to join their Technology organization. As a key member of the team, you will play a crucial role in shaping the future of education in Europe.Project OverviewThe primary objective of this role is to establish the key technical...

  • Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Big Data Job DescriptionWe are seeking an experienced Big Data Developer to work on a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Job ResponsibilitiesThe role involves re-modeling and aggregating data inputs into a common format,...

  • Data Engineer

    3 tygodni temu


    Warszawa, Mazovia, Polska Addepto Pełny etat

    About the Role:We are seeking a skilled Data Engineer to join our team at Addepto, a leading consulting and technology company specializing in AI and Big Data. As a key member of our team, you will be responsible for designing and developing scalable data processing pipelines for streaming and batch processing using Big Data technologies like Databricks,...

  • Cloud Data Engineer

    5 dni temu


    Warszawa, Mazovia, Polska kdrhumanresourcesconsulting Pełny etat

    We are seeking a skilled Cloud Data Engineer to join our team at kdrhumanresourcesconsulting as a Big Data Reliability Expert. This exciting role offers a unique opportunity to work with cutting-edge technologies and contribute to the success of our organization.**Job Description:**As a Cloud Data Engineer, you will be responsible for ensuring the...

  • Big Data Architect

    3 tygodni temu


    Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etat

    Project OverviewSunscrapers sp. z o.o. is a leading force in software development, expanding its presence in data-centric environments.Job DescriptionAs a Senior Data Engineer, you will report to the Head of Data & Analytics and help build the entire data stack and infrastructure that support our operations.Key ResponsibilitiesDesign, build, and maintain...


  • Warszawa, Mazovia, Polska Groupe SII Pełny etat

    At Groupe SII, we are seeking a skilled Senior Big Data Engineer to join our team of experts from the banking industry. We require an individual who is responsible for developing, maintaining, and enhancing data processing systems using Scala and Spark.Job DescriptionWe offer a highly competitive estimated salary of $140,000 per year based on industry...


  • Warszawa, Mazovia, Polska emagine Consulting Pełny etat

    Job OverviewWe are seeking a skilled Big Data Engineer to join our team at emagine Consulting in Warsaw, Poland. This is a hybrid role that offers the opportunity to work on exciting projects in the Financial Crime Prevention sector.

  • Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Jit Team Pełny etat

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Warsaw. This is a 100% remote or hybrid opportunity, offering a flexible work organization and international collaboration.Key ResponsibilitiesProvide first-level support and technical expertise to the DROC team, handling queries related to data engineering tasks.Execute ETL...


  • Warszawa, Mazovia, Polska emagine Consulting Pełny etat

    Job Overview:We are seeking a skilled Big Data Engineer to join our team at emagine Consulting in Warsaw. This is an exciting opportunity to work on implementing real-time analytics solutions using Scala and Spark.About the Role:The ideal candidate will have experience in building distributed and highly parallelized BigData processing pipelines that process...


  • Warszawa, Mazovia, Polska SCALAC Sp. Z O.o. Pełny etat

    About the RoleWe are seeking an experienced Scala developer to join our team as a Big Data Engineer. The ideal candidate will have a strong background in Scala, Hadoop, and Spark, with experience in developing analytics pipelines and data transformations.


  • Warszawa, Mazovia, Polska Sanoma Pełny etat

    Job Description:Sanoma Learning is a leading European learning company serving over 20 million students in 11 countries. We offer printed and digital learning materials as well as digital learning and teaching platforms for primary, secondary, and vocational education. As a Kafka Engineer, you will be responsible for building, improving, and scaling our...

  • Senior AI Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Addepto Pełny etat

    About AddeptoAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one...


  • Warszawa, Mazovia, Polska Addepto Pełny etat

    Company Overview">Addepto is a pioneering consulting and technology company specializing in AI and Big Data, empowering clients to deliver innovative data projects. We partner with leading global enterprises and forward-thinking startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our expertise in AI and Big Data has earned us recognition by...

  • Analista Danych Big Data

    2 tygodni temu


    Warszawa, Mazovia, Polska PKO Leasing S.A. Pełny etat

    Opis stanowiskaZapewniamy ci wyjątkowe warunki pracy i rozwój w PKO Leasing S.A.PłacaOczekiwana pensja to 60.000-80.000 PLN netto na rok, zależnie od doświadczenia i kwalifikacji.Opis zadaniaJesteśmy poszukiwani przez osoby z pasją do analizy danych i raportowania, które chcą pracować w środowisku Big Data. Jesteśmy przekonani, że Ty będziesz...

  • Inżynier DevOps Big Data

    1 miesiąc temu


    Warszawa, Mazovia, Polska Britenet Pełny etat

    Opis StanowiskaPoszukujemy doświadczonego Inżyniera DevOps Big Data, który będzie odpowiedzialny za utrzymanie działania środowiska wewnętrznego, instalację, aktualizację, konfigurację, konserwację i rozwiązywanie problemów z obszaru Big Data.ObowiązkiUtrzymywanie działania środowiska wewnętrznegoInstalacja, aktualizacja, konfiguracja,...

  • Data Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Sanoma Pełny etat

    Are you a data enthusiast looking for a challenging role in a dynamic company? We are seeking a skilled Data Engineer to join our team at Sanoma Learning, a leading European learning company. As a Data Engineer, you will be responsible for designing, developing, and managing Kafka-based data pipelines, working with other big data technologies such as Hadoop,...