Senior Data Engineer Databricks

1 tydzień temu

Kraków, małopolskie, Polska Grape Up Pełny etat 24 zł

At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.

We partner with industry leaders, from the automotive and finance industry, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.


Responsibilities

  • Implement a scalable architecture capable of handling the high volume of simulation data

  • Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform

  • Define KPIs to measure the improved reusability and automation of the new pipelines and test their performance in an end-to-end setting with model training

  • Develop and implement processes and best practices for data management and governance

  • Optimize and enhance system setup and improve data structures following industry best practices

  • Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs

  • Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions

  • Lead technical discussions and solution design sessions with clients or internal stakeholders, presenting complex data engineering concepts in accessible ways

Requirements:

  • Master’s degree in computer science, Data Engineering, AI, or a related field

  • 4+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines

  • Proven experience with Databricks platform (Azure Databricks or Databricks on AWS)

  • Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing

  • Proficiency in Python and SQL for data transformations and analytics workloads

  • Experience with data pipeline orchestration (Airflow, Dagster, Prefect or similar)

  • Experience with data governance and quality frameworks

  • Strong problem-solving skills and ability to work independently

  • Fluency in English, both written and spoken

Nice to have:

  • PhD degree in computer science, Data Engineering, AI, or a related field (completed or in progress)

  • Advanced Databricks expertise (Unity Catalog, Delta Lake and Lakehouse architecture)

  • Data Engineer (Databricks) certificate

  • Experience processing high-volume Automotive or IoT data (e.g., telemetry, sensor, or event-based data)

  • Experience in pre-sales and consulting activities

  • Experience with streaming tools like Kafka or Azure Event Hubs, etc.

  • Experience with Infrastructure as Code (Terraform, CloudFormation)

  • Data Engineer Databricks

    3 tygodni temu

    Kraków, małopolskie, Polska HiQo Solutions Pełny etat

    Hello! It's nice to have you here! Let us introduce ourselves At HiQo Solutions we focus on developing entire IoT systems. We are US-based company, headquartered in Atlanta with delivery centers in Europe. Since 2007, we have delivered top-tier software engineering and IT consulting across healthcare, finance, logistics, and manufacturing. Our teams work on...

  • Databricks Data Engineer Architect

    3 tygodni temu

    Kraków, małopolskie, Polska Upvanta sp. z o.o. Pełny etat 26 zł - 880 zł

    Databricks Data Engineer / ArchitectWe’re looking for an experienced Senior Data Engineer to join our team. If you’re passionate about data, modern platforms, and solving complex problems at scale, this opportunity is for you.What you’ll do:You’ll work with cutting-edge data platforms, design and maintain large-scale data pipelines, and collaborate...

  • Senior Databricks Engineer

    3 tygodni temu

    Kraków, małopolskie, Polska CRODU Pełny etat 30 zł - 240 zł

    Cześć! Dla naszego klienta z USA poszukujemy Azure DataBrick Engineerów. Prace dotyczą działań w obszarach m.in. migracji, zbierania danych i optymalizacji rozwiązań opartych na DataBricks. Klient posiada stałe zapotrzebowanie na specjalistów. Projekty, które prowadzą przeważnie są krótkoterminowe (ze sporym prawdopodobieństwem na...

  • Senior Data Engineer – AWS Databricks Python

    3 tygodni temu

    Kraków, małopolskie, Polska Upvanta sp. z o.o. Pełny etat 23 zł - 100 zł

    Poszukujemy doświadczonego Senior Data Engineera, który będzie odpowiedzialny za projektowanie, rozwój i utrzymanie nowoczesnych rozwiązań w zakresie przetwarzania i integracji danych. Osoba na tym stanowisku będzie blisko współpracować z analitykami, data scientistami oraz inżynierami ML, wspierając rozwój innowacyjnych projektów danych.Zakres...

  • Data Engineer Databricks Azure Mid Senior

    3 dni temu

    Kraków, małopolskie, Polska MW Consulting Pełny etat 20 zł - 160 zł

    We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.Avanade website; Privacy policyThis role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).Position:As Data Engineer, you will broaden your experience by working in modern projects for...

  • Mid Data Engineer Databricks

    2 tygodni temu

    Kraków, małopolskie, Polska N-iX Pełny etat 4 zł - 500 zł

    #4362Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...

  • Senior Data Engineer

    3 tygodni temu

    Kraków, małopolskie, Polska Scalo Pełny etat 23 zł

    W Scalo zajmujemy się dostarczaniem projektów software'owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom.Obszary...

  • Senior Data Engineer

    3 tygodni temu

    Kraków, małopolskie, Polska hubQuest Pełny etat 28 zł - 500 zł

    We are a team of experts bringing together top talents in IT and analytics. Our mission is to build high-performing data and technology teams — from the ground up or by scaling existing ones — to help our partners become truly data-driven organizations.Currently, we are looking for a Senior Data Engineer to join the Global Analytics Unit, a global,...

  • Lead Data Engineer Databricks

    3 tygodni temu

    Kraków, małopolskie, Polska N-iX Pełny etat 8 zł

    #4151Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...

  • Lead Data Platform Engineer Databricks Data Mesh Architecture

    3 tygodni temu

    Kraków, małopolskie, Polska Kolomolo Pełny etat

    Lead Data Platform Engineer (Databricks/ Data Mesh Architecture) Location: European Union (Remote or Hybrid) Full-TimeJoin the Future of Digital Tech with KolomoloAt Kolomolo, we don’t just follow trends - we set them. As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize...