Senior Big Data Engineer

2 tygodni temu


Warsaw, Polska Allegro Pełny etat
Expected, Scala, Python, Java, AWS, Google Cloud Platform, Microsoft Azure, Apache Spark
Operating system, Linux
About the project, The salary range for this position is (contract of employment):, , mid: PLN in gross terms, senior: PLN in gross terms, , A hybrid work model that incorporates solutions developed by the leader and the team

Your responsibilities, As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland.

Data & AI is a group of over 150 experienced BigData engineers organized into over a dozen teams with various specializations.

Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization.

Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform.

There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning., We are looking for BigData engineers who want to build a highly scalable and fault-tolerant data ingestion for millions of Allegro customers.

The platform collects 5 billion clickstream events every day (up to 150k / sec) from all Allegro sites and Allegro mobile applications.

This is a hybrid solution using a mix on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow.

Are programming in languages such as Scala, Python or Java, Strong understanding of distributed systems, data storage, and processing framework - Spark.

, Have knowledge of GCP (especially Composer) or other public cloud environments like Azure or AWS, Use good practices (clean code, code review, TDD, CI/CD), Navigate efficiently within Unix/Linux systems, Possess a positive attitude and team-working skills, Are eager for personal development and keeping their knowledge up to date, Know English at B2 level
This is how we work, in house
This is how we work on a project, Clean Code, code review, TDD, Continuous Deployment, Continuous Integration
Development opportunities we offer, development budget, industry-specific e-learning platforms, intracompany training

What we offer, Possibility to learn and work with backend (Spring, Kotlin), frontend (angular) and AI technologies within the team., A hybrid work model that you will agree on with your leader and the team.

We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms), Annual bonus up to 10% of the annual salary gross (depending on your annual assessment and the company's results), A wide selection of fringe benefits in a cafeteria plan – you choose what you like (e.g.

medical, sports or lunch packages, insurance, purchase vouchers), English classes that we pay for related to the specific nature of your job, A 16" or 14" MacBook Pro with M1 processor and, 32GB RAM or a corresponding Dell with Windows (if you don't like Macs) and other gadgets that you may need, Working in a team you can always count on — we have on board top-class specialists and experts in their areas of expertise, A high degree of autonomy in terms of organizing your team's work; we encourage you to develop continuously and try out new things, Wide range of internal and external trainings and time to participate, hackathons, team tourism, training budget and an internal educational platform, MindUp (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues), If you want to learn more, check it out
Benefits, sharing the costs of sports activities, private medical care, sharing the costs of foreign language classes, sharing the costs of professional training & courses, life insurance, flexible working time, integration events, no dress code, leisure zone, extra social benefits

Why is it worth working with us, At Allegro, you will be responsible for processing petabytes of data and billions of events daily, You will become a participant in one of the largest projects of building a data platform in GCP, Your development will align with the latest technological trends based on open source principles (data mesh, data streaming), You will have a real impact on the direction of product development and technology choices.

We utilize the latest and best available technologies, as we select them according to our own needs, You will have the opportunity to work within a team of experienced engineers and big data specialists who are eager to share their knowledge, including publicly through , Once a year, you can take advantage of the opportunity to work in a different team or more often if there's an internal business need (known as team tourism)

Allegro , Allegro, the most popular shopping platform in Poland and the largest e-commerce platform of European origin, is now connected with the Mall Group and WE|DO.

We became a leading marketplace platform for European customers and merchants and enabled international merchants from across the wider geographical footprint and beyond to benefit from listing once and selling everywhere, while granting tens of millions of EU consumers convenient access to improved selection, best prices and delivery experience., , We are constantly improving the shopping experience and provide the broadest selection at best prices and maximum convenience for 70m potential customers across the region (Poland, the Czech Republic, Slovakia, Hungary, Slovenia, and Croatia).



  • Warsaw, Polska Big Human Pełny etat

    The Company We’re Big Human, a digital product studio that’s been solving complex problems since 2010. We’re part client-services, part internal lab. We create beautiful online experiences, as well as incubate our own ideas. We’ve built, launched, and sold our own products, which gives us valuable insights into creating leading-edge tech for our...


  • Warsaw, Polska Nordea Bank Pełny etat

    Job ID: 25161  #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...

  • Senior Big Data Engineer

    2 miesięcy temu


    Warsaw, Polska Grid Dynamics Poland Pełny etat

    technologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL MySQL PostgreSQL MongoDB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and...

  • Senior Big Data Engineer

    3 miesięcy temu


    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Senior Big Data Engineer

    4 tygodni temu


    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Site Reliability Engineer

    4 tygodni temu


    Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etat

    technologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...


  • Warsaw, Polska Capco Poland Pełny etat

    WHY JOIN CAPCO? Employment contract and/or Business to Business - whichever you prefer Possibility to work remotely Speaking English on daily basis, mainly in contact with foreign stakeholders and peers Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance) Access to 3.000+ Business Courses Platform (Udemy) Access to...


  • Warsaw, Polska Neontri Pełny etat

    Cześć,  Z tej strony  Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej  tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy...

  • Senior Data Engineer

    2 tygodni temu


    Warsaw, Polska VGW Pełny etat

    Senior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games.   We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...

  • Specjalista Big Data

    2 tygodni temu


    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Specjalista Big Data

    4 tygodni temu


    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Big Data Engineer

    7 dni temu


    Warsaw, Polska Integer Group Services Sp. z o.o Pełny etat

    Big Data Engineer Miejsce pracy: Warszawa Your responsibilities Building a platform for processing large amounts of data Building streaming solutions Construction and maintenance of data lake solutions, NoSQL databases Building CI/CD solutions, test automation CI/CD solutions, test automation Designing and maintaining ETL/ELT Applying good practices, code...


  • Warsaw, Polska Orange Polska Pełny etat

    As a Big Data Engineer at Orange you will use your expertise in the field of Data solutions and data pipeline development to enable the processing of a significant volume of data for various stakeholders (including Data Visualization, Data Scientists, and Data Analysts) in the GSP (Global Support for Performance which is the GBS Finance of the Orange Group)....

  • Senior Data Engineer

    2 tygodni temu


    Warsaw, Polska Allegro Pełny etat

    The salary range for this position is PLN in gross terms (contract of employment)A hybrid work model that incorporates solutions developed by the leader and the teamWe are looking for a Senior Data Engineer with a focus on the data processing and preparation, deployment and maintenance of our ML/data projects. Join our team to enhance your skills related to...

  • Senior Data Engineer

    4 tygodni temu


    Warsaw, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...

  • Senior Data Engineer

    1 miesiąc temu


    Warsaw, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...


  • Warsaw, Polska Nordea Bank Pełny etat

    Job ID: 24291  We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. As one of the biggest employers in the Nordics, Poland and Estonia, you have excellent opportunities to evolve, develop and move forward with us.  We enable...


  • Warsaw, Polska SwingDev Pełny etat

    We are a Polish branch of a fast-growing InsurTech product company from Silicon Valley - Hippo Insurance. Our mission is to revolutionize home insurance in the US, starting from IoT monitoring devices to our industry-leading software. How do we want to get there? We need a top-notch talent, just like you! Putting a lot of effort into hiring top-tier...

  • Senior Data Engineer

    4 tygodni temu


    Warsaw, Polska Appcast Inc Pełny etat

    Job Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract...

  • Senior Data Engineer

    4 tygodni temu


    Warsaw, Polska Appcast Pełny etat

    Job DescriptionThe Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data...