Senior Data Engineer

5 dni temu

Katowice, Silesia, Polska Reply Pełny etat 80 000 zł - 120 000 zł rocznie

Responsibilities

  • Implement data-facing backend features: analyze, design, and code services that read/write Delta tables, respecting schema evolution and time travel; document APIs and data contracts.
  • Validate feasibility of new requirements within the existing medallion architecture; propose changes to bronze/silver/gold layers and indexing/partitioning where needed.
  • Design and maintain interfaces to enterprise systems and BI tools; coordinate with interfacing parties and data governance for schema and access approvals.
  • Create unit tests and component integration tests for Spark/SQL and service endpoints; establish data quality checks and reconciliation steps.
  • Optimize performance and security: tune Spark jobs, improve query plans, enforce access controls, and ensure auditability.
  • Maintain build and configuration: manage YAML pipelines in Azure DevOps, version artifacts, and automate deployments to Databricks environments.
  • Drive DevOps for data services: monitoring, alerting, and incident-aware coding; assess release impacts on operations and downstream consumers.
  • Conduct code reviews via pull requests; lead bug fixing with root cause analysis and preventive controls at data and code levels.

Qualifications

  • Successfully completed degree in Computer Science, Mathematics, Physics, or related field.
  • At least 6 years overall engineering experience with 4+ years in Data Engineering with Apache Spark on Azure Databricks; proven delivery of production-grade pipelines.
  • With strong communication skills enabling effective collaboration with customers and teams.
  • Strong Data Engineering Core: Apache Spark, Delta Lake, Medallion architecture
  • Experience with Azure Databricks (workspaces, clusters/pools, secrets), Azure Data Lake Storage Gen2, serving layers on Azure SQL.
  • Nice to have: investment/asset management domain knowledge (ESG, alternatives, performance analytics), KPI lineage, event streaming (Azure Event Hub/Kafka).
  • Very good communication in English and Polish (German is a plus)
  • Openness to visit Kraków or Katowice office up to 2×/month.

About Cluster Dynamics Reply

Cluster Reply is the Reply Group company specialising in consulting and system integration of Microsoft technologies. As a Microsoft partner, Cluster Reply is active in Germany, Austria and Switzerland and works within the Reply network with sister companies in Brazil, Great Britain, Italy as well as the USA. The company focuses on innovation and supports customers in their digital transformation. The solutions range from on-premises to cloud applications in the areas of modern workplace and security, business applications, applications and infrastructure as well as data and artificial intelligence.

  • Databricks Senior Data Engineer

    3 dni temu

    Katowice, Silesia, Polska Deloitte Pełny etat 60 000 zł - 120 000 zł rocznie

    Description & RequirementsWho we are looking forJoin Our AI & Data Team – Where innovation meets impactReady to shape the future with data?At Deloitte's AI & Data team, we do more than deliver solutions -we co-create them with our clients.You'll work in an international, diverse, andfuture-facing environment,solving complex challengesfor some of the...

  • Data Engineer

    3 dni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat 500 000 zł - 1 000 000 zł rocznie

    Company Description Vattenfall is a European energy company with approximately employees. For more than 100 years we have electrified industries, supplied energy to people's homes and modernized our way of living through innovation and cooperation. We are looking for talented individuals who, in addition to their passion for their own role, also have strong...

  • Data Engineer

    3 dni temu

    Katowice, Silesia, Polska ING Hubs Poland Pełny etat 40 000 zł - 80 000 zł rocznie

    About The RoleWe are seeking a skilled and forward-thinkingData Engineerto join our team. This role is ideal for someone who thrives in dynamic environments, brings hands-on experience in building robust ETL pipelines, and is eager to contribute fresh perspectives to improve our engineering practices.Initially, your focus will be on designing and maintaining...

  • Data- & Platform Engineer

    5 dni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat 60 000 zł - 100 000 zł rocznie

    Company DescriptionVattenfall is a European energy company with approximately employees. For more than 100 years we have electrified industries, supplied energy to people's homes and modernized our way of living through innovation and cooperation. We are looking for talented individuals who, in addition to their passion for their own role, also have strong...

  • Junior Data Engineer

    5 dni temu

    Katowice, Silesia, Polska JWM Energia Pełny etat 30 000 zł - 60 000 zł rocznie

    Who are we?JWM Energia is an investment company with over 12 years of experience trading on European energy markets (power, gas, oil, emissions). We are a member of most European power exchanges as well as an active participant in OTC markets. We have offices in Poland and abroad. We focus on physical trading in intraday and day-ahead markets, as well as...

  • Data Operations Engineer

    3 dni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat 60 000 zł - 80 000 zł rocznie

    Company Description Vattenfall is a European energy company with approximately employees. For more than 100 years we have electrified industries, supplied energy to people's homes and modernized our way of living through innovation and cooperation. We are looking for talented individuals who, in addition to their passion for their own role, also have strong...

  • Senior / Lead Full Stack Engineer - JVM, Kotlin

    3 dni temu

    Katowice, Silesia, Polska Simple Machines Pełny etat

    Senior / Lead Full Stack Engineer (Remote) - Multiple rolesSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, data engineering, and software engineering.  We design and...

  • Senior / Lead Full Stack Engineer - JVM, Kotlin

    5 dni temu

    Katowice, Silesia, Polska Simple Machines Pełny etat 80 000 zł - 120 000 zł rocznie

    Senior / Lead Full Stack Engineer (Remote) - Multiple rolesSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, data engineering, and software engineering.  We design and...

  • Senior Software Engineer

    3 dni temu

    Katowice, Silesia, Polska Next Technology Pełny etat 40 000 zł - 50 000 zł rocznie

    Dla naszego klienta poszukujemy kandydatów na stanowisko:Senior Software Engineer (Java Projekt: Dla amerykańskiej firmy z branży weryfikacji danych/background screeningu. Praca w centrum technologicznym w Katowicach z zespołem z Estonii i innych lokalizacji na całym świecie. Projekt obejmuje rozwój i utrzymanie aplikacji, wspierających globalną...

  • Senior DevOps Engineer

    5 dni temu

    Katowice, Silesia, Polska Recbot Pełny etat 100 000 € - 120 000 € rocznie

    B2B | Remote | Long-term | Start: January 2026 | German C1 | Payment in EURWe're looking for aSenior DevOps Engineerto join a long-term international project focused onSAP S/4HANA and BW4HANA migrationandcloud platform development on AWS.You'll work on designing and maintaining Kubernetes-based infrastructure, automating deployments, and supporting...