Databricks Data Engineer

2 tygodni temu


Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat
  • Designing and implementing solutions for processing large and unstructured datasets, including Data Lake Architecture and Streaming Architecture
  • Implementing, optimizing, and testing modern DWH/Big Data solutions using Databricks Platform within a Continuous Delivery/Continuous Integration environment
  • Improving data processing efficiency and managing migrations from on-premises to public cloud platforms
  • Development of Data, AI, and ML applications, as well as Generative AI solutions

Requirements:

  • 4+ years of experience in Big Data or Cloud projects in the areas of processing and visualization of large and/or unstructured datasets (including at least 1 year of hands-on Databricks experience)
  • Practical knowledge of at least one Public Cloud platform in Storage, Compute (+Serverless), Networking and DevOps areas supported by commercial project work experience
  • At least basic knowledge of SQL and one of programming languages: Python/Scala/Java/bash
  • Very good command of English

Frequently used technologies:

  • Databricks
  • Python/PySpark
  • SQL

Offer:

  • Very extensive professional and language training package
  • Cloud training (the company is a platinum partner of AWS, Azure, GCP)
  • Car subscription (preferential lease of a new car – Master Benefit)
  • Free parking and bike boxes

Duties:

  • Designing and implementing solutions for processing large and unstructured datasets, including Data Lake Architecture and Streaming Architecture
  • Implementing, optimizing, and testing modern DWH/Big Data solutions using Databricks Platform within a Continuous Delivery/Continuous Integration environment
  • Improving data processing efficiency and managing migrations from on-premises to public cloud platforms
  • Development of Data, AI, and ML applications, as well as Generative AI solutions

Requirements:

  • 4+ years of experience in Big Data or Cloud projects in the areas of processing and visualization of large and/or unstructured datasets (including at least 1 year of hands-on Databricks experience)
  • Practical knowledge of at least one Public Cloud platform in Storage, Compute (+Serverless), Networking and DevOps areas supported by commercial project work experience
  • At least basic knowledge of SQL and one of programming languages: Python/Scala/Java/bash
  • Very good command of English

Frequently used technologies:

  • Databricks
  • Python/PySpark
  • Cloud: Azure, AWS, GCP
  • SQL

Offer:

  • Very extensive professional and language training package
  • Cloud training (the company is a platinum partner of AWS, Azure, GCP)
  • Medical care, insurance, Multisport
  • Car subscription (preferential lease of a new car – Master Benefit)
  • Flexible working hours
  • Free parking and bike boxes
Permanent job offer.

Opis Firmy

#J-18808-Ljbffr
  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Scalo Sp. z o.o. Pełny etat

    Senior Data Engineer (DataBricks + SQL + Python) Wrocław, Województwo dolnośląskie Senior Data Engineer (DataBricks + SQL + Python) Wrocław Wrocław, Lower Silesian Voivodeship, Polska uczestnictwo w międzynarodowym projekcie z branży automotive, w odniesieniu do usprawnienia systemu do zarządzania materiałami, przygotowania raportu Power BI, który...

  • data engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Santander Pełny etat

    data engineerCountry: Poland DATA ENGINEER Zadania, które będziesz realizować: Rozwijać się w różnych technologiach on-premise oraz chmurowych Azure, AWS, Databricks, Jenkins, GitHub Actions, Python, PowerBI, Ab Initio, Teradata, BMC Control-M, Oracle, Apex, bash/ksh) Utrzymanie stabilności środowisk Databricks na platformie Azure Budowanie...

  • Data Engineer @ Avenga

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska AVENGA Pełny etat

    For our client, we are seeking an additional data engineer to support new use cases in the area of BI and analytics within the operations and purchasing domains at VCE.The role involves working closely with various stakeholders to develop and implement robust analytical solutions, ensuring the efficient management and utilization of data to drive informed...

  • Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Groupe SII Pełny etat

    We are looking for Data Engineer for one of our projects in the automotive industry. This person will be responsible for supporting new BI & Analytics use cases and implementation and design of state-of-the-art data processing to the Scrum working methodology. Don't miss this exciting opportunity and apply Your role Developing features Supporting internal...

  • Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Groupe SII Pełny etat

    We are looking for Data Engineer for one of our projects in the automotive industry.This person will be responsible for supporting new BI & Analytics use cases and implementation and design of state-of-the-art data processing to the Scrum working methodology.Your roleDeveloping featuresSupporting internal users and processes by solving maintenance and data...


  • Wrocław, Województwo dolnośląskie, Polska Epam Pełny etat

    Description Are you a seasoned Data Virtualization Engineer skilled in Databricks and Denodo? Join our team as a Senior Data Virtualization Engineer, where you'll be at the forefront of an exciting project in the Client's Asset Management division. Leverage your expertise in data virtualization, storage, processing, and streaming data at scale to develop...

  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Limango Pełny etat

    Senior Data Engineer At limango we have a long history specializing in e-commerce. As part of the OTTO Group, one of Europe's top e-commerce companies, we offer the largest product selection for families across platforms in the Netherlands, Poland, Austria, and Germany. Your role and main tasks Development of Central Lakehouse Data Platform based on AWS /...

  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    Project descriptionWe are embarking on an exciting project that requires expertise in a diverse range of technologies. This project aims to enhance our systems' efficiency and performance through the implementation of cutting-edge tools and methodologies. As part of our team, you will be responsible for deploying and maintaining critical infrastructure...


  • Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etat

    Senior Data Virtualization Engineer Wroclaw, Poland or Remote Wrocław, Lower Silesian Voivodeship Senior Data Virtualization Engineer Wroclaw, Poland or Remote 96206Engineer solutions focused on data virtualization, distributed processing, and cloud-based large data storage architectureCreate and implement highly scalable and reliable data distribution...

  • Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Sii Ukraїna TOV Pełny etat

    We are looking for Data Engineer for one of our projects in the automotive industry. This person will be responsible for supporting new BI & Analytics use cases and implementation and design of state-of-the-art data processing to the Scrum working methodology.Don't miss this exciting opportunity and apply We are looking for Data Engineer for one of our...

  • Azure Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Brs Sp. Z O.o. Pełny etat

    Technologies-expected : Microsoft Azure Azure Data Factory Azure Synapse Databricks Azure SQL SQL Python Py Spark Spark SQL technologies-optional : Microsoft SQL Server Oracle Teradata about-project : Business Reporting Solutions has recently acquired many potential project opportunities that exceed our current team's capabilities.To fulfil these...

  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Rite NRG Pełny etat

    Senior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi umiejętnościami możesz się pochwalić?Jesteś...

  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Limango Polska Pełny etat

    Remote/WroclawB2B contract – daily rate plnYour role and main tasksDevelopment of Central Lakehouse Data Platform based on AWS / Databricks ecosystemManaging data infrastructure (Terraform AWS / Databricks) and ETL code (PySpark, Delta Live Tables, SparkSQL)Implementing monitoring, data quality tests, unit testing for code, and automated alerts into the...


  • Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etat

    Senior Data Virtualization Engineer Wroclaw, Poland or Remote96206ObowiązkiEngineer solutions focused on data virtualization, distributed processing, and cloud-based large data storage architecture Create and implement highly scalable and reliable data distribution solutions using Python, Spark, & open-source technologies to deliver data to business...

  • Senior Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Limango GmbH Pełny etat

    As limango we create a company which has been specializing in e-commerce for 17 years. Together with platforms in the Netherlands, Poland, Austria and Germany, we are part of the OTTO Group, one of Europe's leading e-commerce companies. We are the shopping platform with the largest selection of products for the whole familyWe work and play together. We value...


  • Wrocław, Województwo dolnośląskie, Polska Cyclad Pełny etat

    In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting edge technologies that shape the world of the future. We are seeking a skilled Data Engineer to work on implementing a new data platform for a new Annual Motor Insurance Product. The platform will operate within a Lakehouse environment,...

  • Senior Python Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etat

    Senior Python Engineer (with Pandas and AWS) Poland Wrocław, Lower Silesian Voivodeship Senior Python Engineer (with Pandas and AWS) Poland 95353Build and enhance a highly concurrent backend system for processing large volumes of data, using Python and packages like Pandas, Numpy, SQLAlchemyWork with high performance computingWork with bigdata storage and...

  • Senior Data Engineer @

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska SNI Pełny etat

    SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.We're on the lookout for a Senior Data Engineer for one of our key clients.Job details:Full-time 1st contract till the end of 2024 Location: pref. Wroclaw area or close locations but open for 100% remote...

  • Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    We are Addepto where you can feel a startup atmosphere We believe that the only constant in life is change, so we try to keep developing and improving to become better at what we do every day We act outside the box and create and deliver the best solutions in Big Data, Machine Learning and Artificial Intelligence . For our team based in Warsaw and...

  • Azure Data Engineer

    1 miesiąc temu


    Wrocław, dolnośląskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Azure Data EngineerWorkplace...