Data Engineer with Microsoft Fabric

1 tydzień temu


Gdańsk, Pomerania, Polska Antal Sp. z o.o. Pełny etat
Antal jest liderem rekrutacji specjalistów i menedżerów oraz doradztwa HR. Marka obecna jest w 35 krajach, w Polsce działa od 1996 roku.

Biura w Warszawie, Wrocławiu, Krakowie, Poznaniu oraz Gdańsku prowadzą projekty w Polsce i za granicą, dla największych globalnych oraz lokalnych przedsiębiorstw z wszystkich sektorów gospodarki.

Data Engineer with Microsoft Fabric

Numer referencyjny:
Miejsce pracy: Gdańsk (pomorskie)

Data Engineer to work on implementing a new data platform for a new Annual Motor Insurance Product. The platform will be a Lakehouse environment using the medallion architecture in Microsoft Fabric.

The candidate will be expected to work with the Director of IT and Business Intelligence Analysts to ingest motor insurance data from multiple sources, assist with design of Lakehouse and warehouse table schemas, manage and enhance data quality and ensure project complies with Data Governance requirements.

This role is pivotal in delivering management information and reporting for new Annual insurance product and providing key data to Pricing, Underwriting and Fraud teams.


Key Responsibilities:

Implement Medallion Architecture:

Apply the medallion architecture to organise data layers (Bronze, Silver, Gold) within the Lakehouse, ensuring progressive enhancement of data quality.


Design and Optimize Data Storage:
Develop scalable and secure data storage solutions that align with the medallion architecture principles

Develop Data Processing Pipelines:
Construct and maintain robust data pipelines for efficient data ingestion, transformation, and consolidation.

Ensure Data Quality and Compliance:
Uphold high standards of data governance, ensuring compliance with industry regulations and data privacy laws

Collaborate with Cross-Functional Teams:
Work closely with stakeholders across the company to understand data requirements and deliver insights that drive strategic decisions.

Skills and Qualifications:
Proficiency in SQL and Python as data processing languages .

Experience with Apache Spark or Databricks as data processing engines Strong experience with Lakehouse patterns and medallion architecture in data engineering.

Familiarity with Azure Data Services and other relevant data management tools including Microsoft Fabric, Synapse Analytics and Data Factory.

Technical requirements

Proficiency in SQL and Python as data processing languages .

Experience with Apache Spark or Databricks as data processing engines

Strong experience with Lakehouse patterns and medallion architecture in data engineering.

Familiarity with Azure Data Services and other relevant data management tools including Microsoft Fabric, Synapse Analytics and Data Factory.
  • Process Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska The Chemical Engineer Pełny etat

    Thales people architect identity management and data protection solutions at the heart of digital security. Business and governments rely on us to bring trust to the billons of digital interactions they have with people. Our technologies and services help banks exchange funds, people cross borders, energy become smarter and much more. More than 30,000...

  • Data Architect

    1 tydzień temu


    Gdańsk, Pomerania, Polska Lufthansa Systems Poland Sp. z o.o. Pełny etat

    You will have the following responsibilities: Understand the data domains and data in ADW, Develop ideas to enhance ADW processes, handling, data areas, and layers, Analyze and propose architectural changes for ADW, Conduct PoC for new approaches in ADW related to potential technology updates, Recommend and drive improvements/optimizations in ETL scripts,...

  • Data Architect

    1 tydzień temu


    Gdańsk, Pomerania, Polska Lufthansa Group Pełny etat

    One of the Lufthansa's largest Analytical Data Warehouse (ADW) system collects, processes and provides data onmany more customer-related topics. In this recruitment, we are looking for Data Architect with strong interest in business topics and data as such. The architect should be the counterpart for business to the discussions about new ideas and...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Craft Pełny etat

    About Craft:Craft is on a mission to illuminate the path to global supply chain resilience. We empower businesses to strengthen their supplier networks and supply chains with the industry's most trusted and comprehensive data fabric and advanced risk mitigation engine. Our easy-to-use platform provides 360-degree visibility to quickly explore and evaluate...

  • ML Engineer/Data Scientist

    1 tydzień temu


    Gdańsk, Pomerania, Polska Craft Pełny etat

    About Craft:Craft is on a mission to illuminate the path to global supply chain resilience. We empower businesses to strengthen their supplier networks and supply chains with the industry's most trusted and comprehensive data fabric and advanced risk mitigation engine. Our easy-to-use platform provides 360-degree visibility to quickly explore and evaluate...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Arla Global Shared Services Sp. Z O.o. Pełny etat

    Technologies-expected : SQL Python R Azure no-SQL Databricks Scala Azure Dev Ops about-project : Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? Join our...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska MindPal Pełny etat

    Data Engineer (Snowflake)Miejsce pracy: Gdańsk Technologies we use Expected SQL Python About the project We are looking for a Data Engineer (Snowflake) to join the team at Mind Pal, working for our key client in the technology sector.We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals,...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska MindPal Pełny etat

    Expected, SQL, PythonAbout the project, We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative solutions,...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Arla foods Pełny etat

    About the jobJoining our commercial IT team is a great opportunity, as this area is currently experiencing significant growth and activity. As a Senior Data Engineer, your main responsibility will be to support the ongoing development and enhancement of our global Data Foundation presence on Microsoft Azure and other platforms.The role involves:Executing...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Inbank Pełny etat

    Banking is moving out of banks and becoming a part of customers' daily digital lives. Inbank's financing solutions are embedded seamlessly into the shopping journey of 5,000+ retailers. This helps our merchant partners to grow their businesses while end customers get to benefit from a frictionless shopping experience wherever they are. With a focus on...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Arla Global Shared Services Sp. z o.o. Pełny etat

    technologies-expected :SQLPythonRno-SQLDatabricksScalaabout-project :Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing?Join our commercial IT organization, which...


  • Gdańsk, Pomerania, Polska Nordea Bank Pełny etat

    Job ID: 25161 #IT #Developer #Data #EngineeringWould you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea's next generation Big Data Platform.In Nordea, we're harnessing the power of technology to reinvent the future of banking. A tech revolution is underway –...

  • Senior Data Engineer

    3 tygodni temu


    Gdańsk, Pomerania, Polska Arla Foods Pełny etat

    Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the jobJoin our commercial IT organization, which is an area that benefits from an increased focus and...

  • Senior Data Engineer

    1 miesiąc temu


    Gdańsk, Pomerania, Polska Arla Foods Pełny etat

    Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the jobJoin our commercial IT organization, which is an area that benefits from an increased focus and...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Arla Foods Deutschland GmbH Pełny etat

    Select how often (in days) to receive an alert: Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the job Join our commercial IT organization,...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Cyclad Pełny etat

    We are looking for a Data Engineer to join the product development team. The Data Engineer will be responsible for the development of internal, custom build, applications to support the business line. The logic of the complex application allows for calculation of target prices based on previous sales patterns, analysis of the current business situation and...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Lufthansa Systems Poland Sp. z o.o. Pełny etat

    Responsibilities:Gathering and analyzing business requirements and expectations,Finding relation between business requirements and existing data model,Identification of new necessary data sources based on business requirements,Providing proof-of-concepts in cooperation with business,Planning of the stories and tasks including estimations for the realization...

  • Senior Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Sunscrapers Pełny etat

    Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...

  • Data Engineer

    1 tydzień temu


    Gdańsk, Pomerania, Polska Lufthansa Group Pełny etat

    One of the biggest Lufthansa Data Warehouse system gathers, processes and provides data about: customers, tickets, journeys, B2B agreements, loyalty systems and many more customer related topics.The majority of the project is realized in Teradata technology based on SQL and bash scripts. The organization is based on the agile methodologies.Gathering and...


  • Gdańsk, Pomerania, Polska Intel Pełny etat

    Job DescriptionWe are designing and building AI Data Centers. Our team's part is to plan out a scalable resilient network fabric supporting AI compute and storage nodes. Part of the job will also be improving and working with automation tools to speed up network provisioning and enhance observability of network health. Help with decision making on the...