Senior Data Engineer Data Platform Architect

1 tydzień temu


Warszawa, mazowieckie, Polska BlueSoft Pełny etat

Project description:

Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center team around Data on Azure Cloud.

Responsibilities:

  • Collaborate with our in-house team to architect, design, and implement scalable data platform for domain-specific data assets on Azure Cloud;
  • Define and document best practices and strategies for data management, integration, and performance optimization;
  • Deep understanding of data modeling, ETL processes, data warehousing concepts, and big data technologies;
  • Develop and maintain data pipelines using Azure Data Factory and Databricks;
  • Utilize Azure Synapse Analytics, Azure Data Lake Storage (ADLS), and Azure SQL Database for data storage and processing;
  • Ensure the data platforms are optimized for performance and reliability;
  • Assist in integrating diverse data sources into the Azure-based data platform, ensuring data consistency and quality;
  • Implement data governance and security measures using Azure Purview and Azure Key;

Requirements:

  • Proficiency in T-SQL - competence in designing and optimizing complex SQL queries;
  • Experience in implementing Data Platforms/ Data Warehouse / Data Lakehouse architecture;
  • Experience in working with technologies such as Azure Data Factory, Azure Synapse, Azure Databricks, Microsoft Fabric, SQL Server;
  • Experience in working with large data volumes;
  • Senior practical experience in development of and knowledge of relational databases, especially MS SQL;
  • Experience in working with Microsoft Power BI, PowerApps, PowerAutomate, Logic Apps;
  • Experience in implementing Databricks Unity Catalog for the purpose of centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces;
  • Experience in configuration and optimization of database engines;
  • Experience in end-to-end of data warehouse implementation;
  • Experience with data modeling, ETL processes, and data warehousing concepts;
  • Proficiency in the Polish and English languages due to work with international team;
  • Strong analytical skills;
  • Effective communication and collaboration skills;

We offer:

‍ Collaboration in a team of interdisciplinary experts and technology enthusiasts inspired by working in a flat hierarchy;

Permanent full-time cooperation in an extraordinary company that has been growing rapidly for 20 years;

A chance to grow in a variety of IT projects for very well-known and recognizable clients-leaders in their industries;

Opportunity to work with the latest technologies based on the highest development standards;

⌚️ Flexible time and hybrid or fully remote working model (different teams have different arrangements, we do not impose any options);

☁ A number of initiatives to support knowledge sharing and development, such as: internal training, topic guilds, Cloud training and certification opportunities (technology partnerships in the four clouds);

Opportunities to learn English or German online and team English lessons;

️‍♂️ Opportunity to join Multisport and medical insurance;

⛵️ Maritime adventures - with us you will sail in the Caribbean, Mediterranean or North Sea (participation in company cruises is subsidized by the company).



  • Warszawa, mazowieckie, Polska N-iX Pełny etat

    Join a dynamic team focused on revolutionizing Transfer Pricing operations through advanced CDP solutions. Our client is on a mission to optimize performance and drive cost-efficiency at every level. If you thrive on solving complex challenges and creating tangible improvements, this role offers the perfect platform to make a significant...

  • Data Analyst

    16 godzin temu


    Warszawa, mazowieckie, Polska Kordian Group sp zoo Pełny etat

    About the CompanyKordian Group and our sister company, Akord LLC, extend and complement IT for marquee brands across the world.We are building and operating excellence centers for clients operating in the United States, Canada, Netherlands, Germany and several other European countries. We work with the latest technologies in data analysis, software...


  • Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Senior Azure Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...

  • Senior Data Scientist

    4 tygodni temu


    Warszawa, mazowieckie, Polska BCF Software Sp. z o.o. Pełny etat

    About Us:BCF Software is at the cutting edge of AI technology, driving innovation through the development of advanced AI solutions. We are seeking a Senior AI/ML Engineer with deep expertise in transformer-based models for both text and images. If you have a passion for pushing the boundaries of AI and machine learning, this is your chance to make a...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Sorigo Pełny etat

    W Sorigo zajmujemy się wdrażaniem innowacyjnych rozwiązań w obszarze IT. Mamy kilkunastoletnie doświadczenie we współpracy partnerskiej z dużymi klientami. Wierzymy także, że praca powinna dawać ludziom satysfakcje, a nie być tylko obowiązkiem. Choć czasami znalezienie odpowiedniego dla siebie miejsca wymaga czasu i dobrego ukierunkowania przez...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska easybrain Pełny etat

    We are looking for a skilled Data Engineer to join our BI team, which is responsible for operating large-scale data pipelines, based on integrations with dozens of sources, collecting a rapidly expanding list of data points on how users interact with our games. Using this vast data, we predict a user’s value and create analytical reports for other teams to...

  • Data Engineer Databricks

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data. Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms. Integrating and transforming data to...

  • Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    ​As a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...

  • Data Engineer

    2 tygodni temu


    Warszawa, mazowieckie, Polska Workday Pełny etat

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...

  • Data Engineer

    2 tygodni temu


    Warszawa, mazowieckie, Polska Workday Pełny etat

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...

  • Data Engineer with GCP

    4 tygodni temu


    Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery) Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…To use Scrum methodology,...

  • Data Engineer with GCP

    4 tygodni temu


    Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery) Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:-- To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…- To use Scrum...


  • Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a driven, naturally curious Senior Data Engineer to join our Digital Experiences team delivering cloud native Big Data solutions within our global Media ecosystem. Our engineering teams work with data on a massive scale and are responsible for the design, development, and continuous innovation of best-in-class solutions supporting P&G as...

  • Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska PAYBACK Pełny etat

    PAYBACK is the world’s leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.Your responsibilities:Develop and migrate data processing, ETL processes, data...


  • Warszawa, mazowieckie, Polska PeakData Pełny etat

    About Us PeakData is a Swiss-based AI startup revolutionizing healthcare by helping patients receive the best treatment available. We empower pharmaceutical companies to enhance their commercial and medical efforts through intelligent healthcare professional identification and engagement. The Opportunity We're seeking a talented Junior to Mid-level Data...

  • Manager Data

    2 tygodni temu


    Warszawa, mazowieckie, Polska Allegro Pełny etat

    As part of the Data & AI area, we implement projects based on the data products and data tools applications of an unprecedented scale in CEE. Data & AI is a group of over 170 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or...

  • Senior Azure Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska KPMG Pełny etat

    Job title descriptionBudowa chmurowych rozwiązań procesujących daneProjektowanie, utrzymanie oraz wdrażanie przepływów danych wsadowych włączając w to procesy ELT, oraz integracje pomiędzy systemami chmurowymi i systemami on-premisesProjektowanie, utrzymanie oraz wdrażanie przepływów danych strumieniowychWdrażania rozwiązań Data...