Senior Big Data Engineer

2 tygodni temu


Warszawa, Mazovia, Polska Allegro sp. z o.o. Pełny etat
  • Full-time
Job Description

The salary range for this position is (contract of employment):

A hybrid work model that incorporates solutions developed by the leader and the team

About the team

As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data & AI is a group of over 150 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning.

We are looking for BigData engineers who want to build a highly scalable and fault-tolerant data ingestion for millions of Allegro customers. The platform collects 5 billion clickstream events every day (up to 150k / sec) from all Allegro sites and Allegro mobile applications. This is a hybrid solution using a mix on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow.

We are looking for people who:

  • Are programming in languages such as Scala, Python or Java
  • Strong understanding of distributed systems, data storage, and processing framework - Spark.
  • Have knowledge of GCP (especially Composer) or other public cloud environments like Azure or AWS
  • Use good practices (clean code, code review, TDD, CI/CD)
  • Navigate efficiently within Unix/Linux systems
  • Possess a positive attitude and team-working skills
  • Are eager for personal development and keeping their knowledge up to date
  • Know English at B2 level

Additionally, we offer:

  • Possibility to learn and work with backend (Spring, Kotlin), frontend (angular) and AI technologies within the team.
  • A hybrid work model that you will agree on with your leader and the team. We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms)
  • Annual bonus up to 10% of the annual salary gross (depending on your annual assessment and the company's results)
  • A wide selection of fringe benefits in a cafeteria plan – you choose what you like (e.g. medical, sports or lunch packages, insurance, purchase vouchers)
  • English classes that we pay for related to the specific nature of your job
  • A16" or 14" MacBook Pro with M1 processor and, 32GB RAM or a corresponding Dell with Windows (if you don't like Macs) and other gadgets that you may need
  • Working in a team you can always count on — we have on board top-class specialists and experts in their areas of expertise
  • A high degree of autonomy in terms of organizing your team's work; we encourage you to develop continuously and try out new things
  • Wide range of internal and external trainings and time to participate, hackathons, team tourism, training budget and an internal educational platform, MindUp (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues)
  • At Allegro, you will be responsible for processing petabytes of data and billions of events daily
  • You will become a participant in one of the largest projects of building a data platform in GCP
  • Your development will align with the latest technological trends based on open source principles (data mesh, data streaming)
  • You will have a real impact on the direction of product development and technology choices. We utilize the latest and best available technologies, as we select them according to our own needs
  • You will have the opportunity to work within a team of experienced engineers and big data specialists who are eager to share their knowledge, including publicly through
  • Once a year, you can take advantage of the opportunity to work in a different team or more often if there's an internal business need (known as team tourism )

Send in your CV and see why it is #dobrzetubyć (#goodtobehere

#J-18808-Ljbffr
  • Senior Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Scalac Pełny etat

    Senior Big Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska We are looking for a Senior Big Data Engineer with Spark who will be working on an external project in the fintech area. But what's more important is that you will still be an integral part of the Scalac team and work with the best specialists As a Big Data Engineer, you will:Work on an...


  • Warszawa, Mazovia, Polska Neontri Pełny etat

    Senior Big Data Engineer @ Neontri Warszawa, mazowieckie Cześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach:tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności) głównie z obszaru: finansowego, bankowego,...

  • Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Smartchoice International Pełny etat

    Job Title: Big Data EngineerLocation: Warsaw, PolandEmployment Type: B2BRole Description:We are seeking a highly skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Spark and Scala in a Cloud PaaS environment, specifically with AWS, Databricks, and Snowflake. The role requires proficiency in the...

  • Senior Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Grid Dynamics Poland Pełny etat

    Technologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL My SQL Postgre SQL Mongo DB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company.The role involves a mix of technical proficiency, strategic thinking, collaboration, and...

  • Senior Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Neontri Pełny etat

    Minimum 5 lat doświadczenia na stanowisku Data EngineeraUkończone studia wyższe (tytuł licencjata lub magistra na kierunku informatyki lub fizyki)Konieczna znajomość jednego z języków - Python, Scala, JavaDoświadczenie z technologiami Big DataWymagana znajomość j. ang na poziomie min. B2+/C1Praca hybrydowa (2-3 dni w tygodniu w biurze, centrum...


  • Warszawa, Mazovia, Polska Neontri Pełny etat

    Cześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy naszych...

  • Senior Data Engineer @

    2 tygodni temu


    Warszawa, Mazovia, Polska Sunscrapers Pełny etat

    Senior Data Engineer @ Sunscrapers Warsaw, Masovian Voivodeship Senior Data Engineer @ Sunscrapers Warszawa Warsaw, Masovian Voivodeship, Polska Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Senior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :DataflowGittechnologies-optional :PythonScalaJavaabout-project :For one of our clients in the pipeline management industry, we are seeking experienced Senior Data Engineers / Infrastructure Programmers.Suitable candidates should have experience in pipeline...

  • Senior Data Engineer z

    2 tygodni temu


    Warszawa, Mazovia, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z j.niemieckim Warszawa, mazowieckie Senior Data Engineer z j.niemieckim Warszawa Warszawa, Województwo mazowieckie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etat

    Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcieSenior Data EngineerTwój zakres obowiązkówOdpowiedzialność za architekturę danych komenrcyjnych w Azure Rozwój modelu danych w chmurze na rzecz procesów BI w...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data...


  • Warszawa, Mazovia, Polska Nordea Bank Pełny etat

    Job ID: 22943 Would you like to be an infrastructure engineer architecting and implementing tomorrow's Big Data capabilities? We are now looking for a subject matter expert to assess new platform capabilities, harden security, improve availability, automate new self service capabilities and support strengthening operational stability. At Nordea, we know our...


  • Warszawa, Mazovia, Polska Nordea Bank Pełny etat

    Job ID: 22943 Would you like to be an infrastructure engineer architecting and implementing tomorrow's Big Data capabilities? We are now looking for a subject matter expert to assess new platform capabilities, harden security, improve availability, automate new self service capabilities and support strengthening operational stability. At Nordea, we know our...

  • Senior Data Engineer @

    2 tygodni temu


    Warszawa, Mazovia, Polska Sunscrapers Pełny etat

    Advance your professional path with Sunscrapers, a key player in software development, currently broadening its influence in a data-centric setting. Join our journey to assist clients in expanding and innovating through a robust tech stack and impactful data-driven projects. Enjoy a competitive salary package reflecting your expertise while being part of a...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska ALTER SOLUTIONS Pełny etat

    Job Description The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Qualifications Minimum 4 years (senior) of experience working with ETL , ...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Alter Solutions Pełny etat

    Job DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting.The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4years (senior) of experience working with ETL, data modeling, and data...


  • Warszawa, Mazovia, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Warszawa, Mazowieckie Senior Data Engineer z jniemieckim Warszawa Warsaw, Masovian Voivodeship, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie. Nasza...


  • Warszawa, Mazovia, Polska Nordea Bank Norge ASA Pełny etat

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Big Data DevOps Engineer, Data Tooling team Job ID: 24291 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. As one of the...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etat

    Senior Data Engineer Warszawa Warszawa, mazowieckie, Polska Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcie Twój zakres obowiązków Odpowiedzialność za architekturę danych komenrcyjnych w AzureRozwój modelu...