Senior Data Engineer

3 tygodni temu


Wrocław, Polska Limango Pełny etat

Senior Data Engineer

As limango we create a company which has been specializing in e-commerce for 17 years. Together with platforms in the Netherlands, Poland, Austria and Germany, we are part of the OTTO Group, one of Europe's leading e-commerce companies. We are the shopping platform with the largest selection of products for the whole family
We work and play together. We value work-life balance and create a culture of respect, trust and equality. If these values are also key for you, there is a good chance that you will find your place with us.

Your role and main tasks

Development of Central Lakehouse Data Platform based on AWS / Databricks ecosystem Managing data infrastructure (Terraform AWS / Databricks) and ETL code (PySpark, Delta Live Tables, SparkSQL) Implementing monitoring, data quality tests, unit testing for code, and automated alerts into the system Refactoring legacy AWS solutions (AWS Glue, Redshift) into monitored and CI/CD deployed Lakehouse ecosystem with data expectations / data quality testing Active support for building medallion lakehouse architecture for ML and analytics data and introducing data-mesh concepts Active support for business analytics and ML teams working on the data platform

You will need

degree in Information Systems, Computer Science, Mathematics/Physics, Engineering, or a related field several years of experience building data engineering solutions (ideally in E-commerce) very good knowledge of Python programming (building applications, automated testing, packaging and deployment)  real experience with PySpark data processing and good understanding of Spark processing engine architecture Advanced SQL processing skills experience with data lakes architecture and data modelling paradigms experience with Terraform infrastructure-as-code and CI/CD deployments experience with building and deploying data engineering ETL applications – CI/CD pipelines in git environments  Fluency in English – we work in an international environment Team player attitude and willingness to learn modern technologies / frameworks Nice-to-have Familiarity with AWS Cloud architecture and Databricks platform will be very welcomed Experience with AWS Glue and Redshift warehousing Experience with CloudFormation templates Experience with AWS Kinesis and Spark streaming processing Good knowledge of Scala coding, functional programming and application development Experience with MLOps environments (e.g., MLFlow)

Benefits

Private health care
We provide access to the best specialists for you and your loved ones. Language classes
English and German lessons in small groups, tailored to your skills. Remote work and flexible working hours 
Possibility of partial remote work, as well as adjusting working hours to your daily schedule. Office in the center of Wrocław
Nearby cinema, fitness club and large selection of lunch places. Fruit Mondays
There is no shortage of coffee, fruit, pizza, sweets and healthy snacks in our office. Company events in the best company
After hours we often organize interesting outings or meetings in our office. What you can count for: Interesting and challenging work in a dynamic environment of the Internet industry - you will not get bored with us The possibility of real shaping of the business - we value independence and delegate responsibility, Gaining experience in an international team, operating in different European markets.

Sounds good?

We can''t wait to get to know you.
  • Senior Data Engineer Flink

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska GetInData | Part of Xebia Pełny etat

    Senior Data Engineer Flink Wrocław, Województwo dolnośląskie Senior Data Engineer Flink Wrocław Wrocław, Lower Silesian Voivodeship, Polska Informacje: Lokalizacja: Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Wrocław - Ciekawe oferty pracy w okolicy:WrocławOferty pracy w okolicznych...

  • Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska Scalo Sp. z o.o. Pełny etat

    Senior Data Engineer (DataBricks + SQL + Python) Wrocław, Województwo dolnośląskie Senior Data Engineer (DataBricks + SQL + Python) Wrocław Wrocław, Lower Silesian Voivodeship, Polska uczestnictwo w międzynarodowym projekcie z branży automotive, w odniesieniu do usprawnienia systemu do zarządzania materiałami, przygotowania raportu Power BI, który...

  • Senior Data Engineer @

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska SNI Pełny etat

    SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.We're on the lookout for a Senior Data Engineer for one of our key clients.Job details:Full-time 1st contract till the end of 2024 Location: pref. Wroclaw area or close locations but open for 100% remote...


  • Wrocław, Województwo dolnośląskie, Polska Kalepa Pełny etat

    Who are we?Kalepa is a fully remote startup dedicated to enhancing underwriting performance and driving profitable premium growth for the commercial insurance industry. Kalepa's AI-powered Copilot software enables underwriters to focus on the highest ROI opportunities and quickly evaluate and optimally select risk. Kalepa is backed by IA Ventures, Inspired...

  • Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska Rite NRG Pełny etat

    Senior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi umiejętnościami możesz się pochwalić?Jesteś...


  • Wrocław, Województwo dolnośląskie, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Wrocław, Lower Silesian Voivodeship Senior Data Engineer z jniemieckim Wrocław Wrocław, Dolnośląskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....

  • Mid Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska TransferGo Pełny etat

    TransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. Now in our 12th year, with over 370 employees in offices across Europe, we're crafting a brilliant, relevant product that makes a difference in...


  • Wrocław, Województwo dolnośląskie, Polska Sunscrapers Pełny etat

    Are you ready to take on the challenge?We're looking for a Senior Data Engineer/Analyst to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and...

  • Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska Shaped Thoughts Sp. Z O.o. Pełny etat

    Technologies-expected : Amazon Redshift Snowflake Google Big Query SQL Python Java technologies-optional : AWS Glue Apache Spark Apache Flink Kinesis Kafka about-project : We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.responsibilities : help...

  • Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska j-labs Pełny etat

    Senior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala użytkownikom na pełną dywersyfikację oraz...


  • Wrocław, Województwo dolnośląskie, Polska Crestt Pełny etat

    Senior Data Engineer Python Pyspark Cloud Wrocław Wrocław, Lower Silesian Voivodeship, Polska CześćJako Senior/Lead Data Engineer będziesz miał możliwość pracy nad kluczowym projektem naszego klienta, który obejmuje budowanie mechanizmu składowania danych decyzyjnych. Projekt ten oferuje unikalną szansę na zaangażowanie w tworzenie i...


  • Wrocław, Województwo dolnośląskie, Polska Epam Pełny etat

    Description Are you a seasoned Data Virtualization Engineer skilled in Databricks and Denodo? Join our team as a Senior Data Virtualization Engineer, where you'll be at the forefront of an exciting project in the Client's Asset Management division. Leverage your expertise in data virtualization, storage, processing, and streaming data at scale to develop...


  • Wrocław, Polska Epam Pełny etat

    Description Are you a seasoned Data Virtualization Engineer skilled in Databricks and Denodo? Join our team as a Senior Data Virtualization Engineer, where you'll be at the forefront of an exciting project in the Client's Asset Management division. Leverage your expertise in data virtualization, storage, processing, and streaming data at scale to...


  • Wrocław, Polska Epam Pełny etat

    Description Are you a seasoned Data Virtualization Engineer skilled in Databricks and Denodo? Join our team as a Senior Data Virtualization Engineer, where you'll be at the forefront of an exciting project in the Client's Asset Management division. Leverage your expertise in data virtualization, storage, processing, and streaming data at scale to...


  • Wrocław, dolnośląskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Senior Azure Data...

  • Senior Azure Data Engineer

    1 miesiąc temu


    Wrocław, dolnośląskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Senior Azure Data...


  • Wrocław, Województwo dolnośląskie, Polska TransferGo Pełny etat

    TransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. Now in our 12th year, with over 370 employees in offices across Europe, we're crafting a brilliant, relevant product that makes a difference in...

  • Senior Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska Limango Pełny etat

    Senior Data Engineer At limango we have a long history specializing in e-commerce. As part of the OTTO Group, one of Europe's top e-commerce companies, we offer the largest product selection for families across platforms in the Netherlands, Poland, Austria, and Germany. Your role and main tasks Development of Central Lakehouse Data Platform based on AWS /...

  • Senior Big Data Engineer

    1 tydzień temu


    Wrocław, Województwo dolnośląskie, Polska Scalac Pełny etat

    We are looking for a Senior Big Data Engineer with Spark who will be working on an external project in the fintech area. But what's more important is that you will still be an integral part of the Scalac team and work with the best specialists As a Big Data Engineer, you will:Work on an external project and develop an application that is based on the Hadoop...


  • Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etat

    Senior Data Virtualization Engineer Wroclaw, Poland or Remote Wrocław, Lower Silesian Voivodeship Senior Data Virtualization Engineer Wroclaw, Poland or Remote 96206Engineer solutions focused on data virtualization, distributed processing, and cloud-based large data storage architectureCreate and implement highly scalable and reliable data distribution...