Data Engineer with Databricks

4 tygodni temu

Warszawa, mazowieckie, Polska KMD Poland Pełny etat 25 zł - 200 zł

Location: Warsaw (Inflancka 4A) or Remote Work (Poland)

B2B Contract, Targeted Salary: 150 - 170 PLN Net/Hour

#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #Kubernetes

Are you ready to join our international team as a Data Engineer with Databricks? We shall tell you why you should

What products do we develop?

KMD Elements is a cloud-based solution tailored for the energy and utility market. It offers a highly efficient way to handle complex data validation and advanced formula-based settlements on time series. Designed for the international market, KMD Elements automates intricate calculation and billing processes. Key features include an advanced configuration engine, robust automation capabilities, multiple integration options, and a customer-centric interface. More info can be found here

How do we work?

#Agile #Scrum #Teamwork #CleanCode #CodeReview #E2Eresponsibility #ConstantImprovement

Your responsibilities:

  • Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python.

  • Have end-to-end responsibility for the full lifecycle of features you develop.

  • Design technical solutions for business requirements from the product roadmap.

  • Ensure optimal performance

  • Refactor existing code and enhance system architecture to improve maintainability and scalability.

  • Design and evolve the test automation strategy, including technology stack and solution architecture.

  • Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.

Ideal candidate:

  • Has 3+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT).

  • Is proficient in Python, with a solid understanding of data processing challenges.

  • Has experience working with Apache Spark and Databricks.

  • Is familiar with MSSQL databases or other relational databases.

  • Has some experience working with distributed systems on a cloud platform.

  • Has worked on large-scale systems and understands performance optimization.

  • Is comfortable with Git and CI/CD practices, and can contribute to deployment processes for data pipelines.

  • Is proactive, eager to learn, and has a strong can-do attitude.

  • Communicates fluently in English and Polish, both written and spoken.

  • Is a team player with excellent collaboration and communication skills.

Nice to Have:

  • Experience with Azure

  • Experience working with SSIS

  • Familiarity with Azure PostgreSQL

  • Knowledge of Docker and Kubernetes

  • Exposure to Kafka or other message brokers and event-driven architecture

  • Experience working in Agile/Scrum environments

  • Data Engineer Databricks

    3 tygodni temu

    Warszawa, mazowieckie, Polska 7N Pełny etat 28 zł - 560 zł

    Data Engineer (Databricks)We are looking for an experienced Data Engineer for our client in the pharmaceutical industry. The role focuses on developing and professionalizing data foundations within the organization.Work mode: 100% remote TasksDesign, develop, test, and maintain robust data pipelines and ETL processes.Implement and manage CI/CD pipelines to...

  • Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska KMD Poland Sp. z o.o. Pełny etat

    Data Engineer with DatabricksMiejsce pracy: WarszawaTechnologies we useExpectedPythonApache SparkDatabricksGitAbout the project#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #KubernetesAre you ready to join our international team as a Data Engineer with Databricks? We shall tell you why you shouldWhat products do we develop?KMD Elements...

  • Senior Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, Polska KMD Poland Pełny etat 26 zł - 880 zł

    Location: Warsaw (Inflancka 4A) or Remote Work (Poland) B2B Contract, Targeted Salary: 160 - 180 PLN Net/Hour #Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #Kubernetes Are you ready to join our international team as a Senior Data Engineer with Databricks? We shall tell you why you should What products do we develop? KMD Elements is a...

  • Databricks Data Engineer Architect

    4 tygodni temu

    Warszawa, mazowieckie, Polska Upvanta sp. z o.o. Pełny etat 26 zł - 880 zł

    Databricks Data Engineer / ArchitectWe’re looking for an experienced Senior Data Engineer to join our team. If you’re passionate about data, modern platforms, and solving complex problems at scale, this opportunity is for you.What you’ll do:You’ll work with cutting-edge data platforms, design and maintain large-scale data pipelines, and collaborate...

  • Senior Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska KMD Poland Sp. z o.o. Pełny etat

    Senior Data Engineer with DatabricksMiejsce pracy: WarszawaTechnologies we useExpectedPythonApache SparkDatabricksGitAbout the project#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #KubernetesAre you ready to join our international team as a Senior Data Engineer with Databricks? We shall tell you why you shouldWhat products do we...

  • Data Engineer Databricks

    4 tygodni temu

    Warszawa, mazowieckie, Polska Addepto Pełny etat 15 zł - 120 zł

    Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for some of the world’s largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With our exclusive focus on Artificial Intelligence and Big Data, we help organizations unlock the full potential of...

  • Azure Databricks Data Engineer

    3 tygodni temu

    Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Azure Databricks Data EngineerAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed...

  • Data Engineer

    3 dni temu

    Warszawa, mazowieckie, mazowieckie, Polska Sollers Consulting Pełny etat

    Data Engineer (with Snowflake/Databricks)Miejsce pracy: WarszawaTechnologies we useExpectedAzureAWSSQLPythonAbout the projectVersatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our mission is...

  • Azure Databricks Data Engineer

    3 dni temu

    Warszawa, mazowieckie, mazowieckie, Polska Capgemini Polska Pełny etat

    Azure Databricks Data EngineerMiejsce pracy: WarszawaTechnologies we useExpectedDatabricksDelta LakeSparkSQLPythonOptionalMLflowPower BIAbout the projectAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver...

  • Mid-Level Data Engineer Azure Databricks

    4 tygodni temu

    Warszawa, mazowieckie, Polska emagine Polska Pełny etat

    General Information:Industry: HealthcareRate: up to 150 PLN/hLocation: 100% remoteThis position seeks a skilled Data Engineer with a minimum of 3 years of experience specializing in Azure Data Services and Databricks. The ideal candidate will have a strong proficiency in SQL and Python, along with a solid understanding of data modeling and architectural...