Senior Data Engineer with Databricks

4 tygodni temu

Warszawa, mazowieckie, Polska KMD Poland Pełny etat 26 zł - 880 zł

Location: Warsaw (Inflancka 4A) or Remote Work (Poland)

B2B Contract, Targeted Salary: 160 - 180 PLN Net/Hour

#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #Kubernetes

Are you ready to join our international team as a Senior Data Engineer with Databricks? We shall tell you why you should

What products do we develop?

KMD Elements is a cloud-based solution tailored for the energy and utility market. It offers a highly efficient way to handle complex data validation and advanced formula-based settlements on time series. Designed for the international market, KMD Elements automates intricate calculation and billing processes. Key features include an advanced configuration engine, robust automation capabilities, multiple integration options, and a customer-centric interface. More info can be found here

How do we work?

#Agile #Scrum #Teamwork #CleanCode #CodeReview #E2Eresponsibility #ConstantImprovement

Your responsibilities:

  • Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python.

  • Have end-to-end responsibility for the full lifecycle of features you develop.

  • Design technical solutions for business requirements from the product roadmap.

  • Ensure optimal performance.

  • Refactor existing code and enhance system architecture to improve maintainability and scalability.

  • Design and evolve the test automation strategy, including technology stack and solution architecture.

  • Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.


Ideal candidate:

  • Has 5+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT).

  • Demonstrates strong programming skills in Python, with a deep understanding of data-related challenges.

  • Has hands-on experience with Apache Spark and Databricks.

  • Is familiar with MSSQL databases.

  • Has experience working with distributed systems on a cloud platform.

  • Has worked on large-scale systems and understands performance optimization.

  • Is comfortable with Git and CI/CD practices, and can design or implement deployment processes for data pipelines.

  • Is proactive, solution-oriented, and has a strong can-do attitude.

  • Communicates fluently in English and Polish, both written and spoken.

  • Is a team player with excellent collaboration and communication skills.

Nice to Have:

  • Experience with Azure

  • Experience working with SSIS

  • Familiarity with Azure PostgreSQL

  • Knowledge of Docker and Kubernetes

  • Exposure to Kafka or other message brokers and event-driven architecture

  • Experience working in Agile/Scrum environments

  • Senior Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska KMD Poland Sp. z o.o. Pełny etat

    Senior Data Engineer with DatabricksMiejsce pracy: WarszawaTechnologies we useExpectedPythonApache SparkDatabricksGitAbout the project#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #KubernetesAre you ready to join our international team as a Senior Data Engineer with Databricks? We shall tell you why you shouldWhat products do we...

  • Databricks Data Engineer Architect

    4 tygodni temu

    Warszawa, mazowieckie, Polska Upvanta sp. z o.o. Pełny etat 26 zł - 880 zł

    Databricks Data Engineer / ArchitectWe’re looking for an experienced Senior Data Engineer to join our team. If you’re passionate about data, modern platforms, and solving complex problems at scale, this opportunity is for you.What you’ll do:You’ll work with cutting-edge data platforms, design and maintain large-scale data pipelines, and collaborate...

  • Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, Polska KMD Poland Pełny etat 25 zł - 200 zł

    Location: Warsaw (Inflancka 4A) or Remote Work (Poland) B2B Contract, Targeted Salary: 150 - 170 PLN Net/Hour #Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #Kubernetes Are you ready to join our international team as a Data Engineer with Databricks? We shall tell you why you should What products do we develop? KMD Elements is a...

  • Data Engineer Databricks

    3 tygodni temu

    Warszawa, mazowieckie, Polska 7N Pełny etat 28 zł - 560 zł

    Data Engineer (Databricks)We are looking for an experienced Data Engineer for our client in the pharmaceutical industry. The role focuses on developing and professionalizing data foundations within the organization.Work mode: 100% remote TasksDesign, develop, test, and maintain robust data pipelines and ETL processes.Implement and manage CI/CD pipelines to...

  • Data Engineer with Databricks

    4 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska KMD Poland Sp. z o.o. Pełny etat

    Data Engineer with DatabricksMiejsce pracy: WarszawaTechnologies we useExpectedPythonApache SparkDatabricksGitAbout the project#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #KubernetesAre you ready to join our international team as a Data Engineer with Databricks? We shall tell you why you shouldWhat products do we develop?KMD Elements...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, mazowieckie, mazowieckie, Polska CRESTT sp. z o.o. Pełny etat

    Senior Data Engineer (Databricks, Python)Miejsce pracy: WarszawaTechnologie, których używamyWymaganeDatabricksPySparkSQLGitAirflowdbtKafkaFlinkFabric Data FactoryPythonMicrosoft AzureO projekcieDołącz do zespołu Specjalistów, który tworzy rozwiązania w obszarze Data Lakehouse, Business Intelligence i Advanced Analytics w środowiskach chmurowych....

  • Data Engineer Databricks

    4 tygodni temu

    Warszawa, mazowieckie, Polska Addepto Pełny etat 15 zł - 120 zł

    Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for some of the world’s largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With our exclusive focus on Artificial Intelligence and Big Data, we help organizations unlock the full potential of...

  • Senior Data Integration Engineer Databricks Snowflake

    4 tygodni temu

    Warszawa, mazowieckie, Polska EPAM Systems Pełny etat

    We are looking for a Senior Data Integration Engineer to join our dynamic Data Practice team and contribute to EPAM's strategic projects.This is a fully remote position, offering the flexibility to work from any location in Poland, whether it's your home or one of our modern offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.As a Senior Data...

  • Azure Databricks Data Engineer

    2 tygodni temu

    Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Azure Databricks Data EngineerAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed...

  • Senior Data Engineer

    4 tygodni temu

    Warszawa, mazowieckie, Polska Optiveum Pełny etat 5 zł

    We're Hiring: Senior Data Engineer (Python, Databricks, SQL) – Warsaw, Poland About the CompanyOur client is a US-based technology company headquartered in New York City, delivering innovative digital solutions and cloud-based platforms for private capital markets. With offices in multiple countries, the company is now investing in a new engineering centre...