Senior Data Platform Engineer

6 dni temu


Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etat

We are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable data architectures based on business needs and work closely with stakeholders to offer technical insights for ongoing and future data platform initiatives.

Senior Data Platform Engineer (Python)


Your responsibilities

  • Design and optimize data ingestion systems to ensure a consistent flow of high-quality data into the platform, creating a solid foundation for developing data products and supporting comprehensive KPI tracking and analysis.
  • Demonstrate expertise in Infrastructure as Code (IaC), utilizing tools like Terraform or CloudFormation to automate infrastructure deployment and management.
  • Translate business requirements into robust technical architecture, including designing physical schema and logical data models.
  • Engage with stakeholders to understand their needs, providing technical guidance for current and future data platform projects.
  • Analyze user interaction with the data platform, focusing on patterns of use to identify areas for improvement and optimize user engagement over time.
  • Implement and maintain data governance frameworks, emphasizing automated processes for data quality checks, compliance adherence, and secure data handling, while collaborating with engineering teams to integrate governance protocols into data pipelines and platform architecture.
  • Participate actively in all Data Platform Engineering team meetings and knowledge-sharing sessions, contributing to team learning and process improvement.

Our requirements

  • Expertise in AWS services, especially Glue, Athena, EMR, EC2, IAM, MWAA
  • Proficiency in Python and PySpark
  • Experience in building data platforms, not just using them
  • Proficiency in data modeling techniques and best practices
  • Experience in implementing data contracts
  • Experience in applying data governance policies
  • Experience with data quality frameworks (Great expectations, Soda)
  • Familiarity with the data mesh architecture and its principles
  • Django experience
  • Important: Strong Python knowledge

What we offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

Aplikuj

 



  • Warszawa, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Senior Azure Data Platform Engineer lokalizacja: Warszawa (mazowieckie) numer referencyjny: 1189893/jobs.pl forma zatrudnienia: Pełny etat Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, Warsaw Your Tasks: - Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. - Designing and managing database schemas to...


  • Warszawa, Polska HAYS Pełny etat

    Senior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...


  • Warszawa, Mazovia, Polska Intuition Machines, Inc. Pełny etat

    **Job Description**We are seeking a seasoned Senior Data Engineer to join our team. The ideal candidate will work closely with ML engineers and researchers to build datasets on demand, influence data storage and processing strategies, and collaborate with various teams to enhance our data platform.


  • Warszawa, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Senior Data Engineer (.NET, Azure) lokalizacja: Warszawa (mazowieckie) numer referencyjny: 1191131/jobs.pl forma zatrudnienia: Pełny etat Your new company: You will join a global company known for its pharmaceutical business, which also carries out projects for the agriculture sector. As a Senior Data Engineer, you will be a part of the company's...


  • Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    **Job Description**A Senior Data Engineer plays a pivotal role in designing and constructing robust data architectures. This position involves crafting tools and procedures to facilitate the collection, storage, manipulation, and analysis of large data volumes. The ideal candidate will have expertise in erecting data platforms atop provided infrastructure...


  • Warszawa, Polska HAYS Pełny etat

    Senior Data Engineer (.NET, Azure)WarszawaNR REF.: 1191131Your new company: You will join a global company known for its pharmaceutical business, which also carries out projects for the agriculture sector.As a Senior Data Engineer, you will be a part of the company39s global agriculture business. You will work on implementing an open agronomic platform...


  • Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    Job Description:We are seeking a highly skilled Senior Platform Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining core infrastructure supporting various software applications and services. Collaborating across diverse teams, including software developers, data engineers, IT...


  • Warszawa, mazowieckie, Polska SimCorp Pełny etat

    Who we are For over 50 years, we have worked closely with investment and asset managers to become the world’s leading provider of integrated investment management solutions. We are 3,000+ colleagues with a broad range of nationalities, educations, professional experiences, ages, and backgrounds.  SimCorp is an independent subsidiary of the Deutsche...


  • Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    Company Overview:GetInData, part of Xebia, is a dynamic organization that offers an innovative work environment. We are seeking a skilled Data Engineer to join our team and contribute to the development of our data infrastructure.

  • Data Engineer Lead

    18 godzin temu


    Warszawa, Mazovia, Polska Spyrosoft Pełny etat

    **About Spyrosoft**We're a cutting-edge fintech company based in Warsaw, collaborating with global industry leaders to drive innovation in digital payment solutions.Our team is looking for top-tier engineers who thrive in dynamic, forward-thinking environments. We value independence, proactiveness, and flexibility.As a Senior/Lead Data Engineer @ Spyrosoft,...


  • Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    About the Role:We are looking for a Senior Azure Data Platform Engineer to join our Hays Poland Sp. z o.o. team in Warsaw. In this role, you will be responsible for managing and optimizing Data/AI workflows using AI orchestrators like LangChain. You will also design and manage database schemas to efficiently meet application data...


  • Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Job Description:">We are seeking a highly skilled Senior Data Engineer to join our team in Warsaw. As a key member of our global agriculture business, you will be responsible for implementing our data strategy and driving data governance to ensure data standardization on our platform.">Key Responsibilities:">">Develop data management concepts, including data...


  • Warszawa, Mazovia, Polska hubQuest Pełny etat

    OverviewHubQuest is a leading player in the data-driven decision-making space, with a global analytics unit that strengthens business outcomes through innovative smart data products. As a Senior Azure MLOps Engineer, you will be part of a diverse collective of professionals driving collaboration, innovation, and reliability across three continents and five...

  • Data Engineer Lead

    2 dni temu


    Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    About the Role:">We are seeking a highly skilled Senior Data Engineer to join our team in Warsaw. As a key member of our global agriculture business, you will be responsible for implementing our data strategy and driving data governance to ensure data standardization on our platform.">Key Responsibilities:">">Develop data management concepts, including data...


  • Warszawa, Mazovia, Polska Experis Manpower Group Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at Experis Manpower Group. About the RoleThe ideal candidate will have extensive experience in designing, developing, and optimizing scalable data pipelines using Databricks and Apache Spark. You will be responsible for building and maintaining ETL workflows to process...


  • Warszawa, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Data Platform Engineer, Digital Experiences47_R000108298Obowiązki Work as a key member of a multi-disciplinary product team including engineers, product managers, and designers delivering innovative digital solutions following Agile & DevOps best practices.Drive the development and implementation of tools and automations that help scale data...


  • Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Job DescriptionWe are seeking a highly skilled Data Platform Engineer to join our team at Procter and Gamble Polska Sp. z o.o.Company OverviewAs a key member of our product team, you will be responsible for delivering innovative digital solutions following Agile and DevOps best practices.Key Responsibilities:Develop and implement tools and automations that...


  • Warszawa, mazowieckie, Polska Alter Solutions Polska Pełny etat

    Company DescriptionOur mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying...


  • Warszawa, Polska B2B.net S.A Pełny etat

    Senior Data EngineerYour responsibilities Working with Spark & Python to define and maintain data ingestions and transformation Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured...


  • Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    Job DescriptionWe are looking for an experienced Data Engineer to craft and maintain the structure, tools, and procedures essential for gathering, storing, modifying, and scrutinizing extensive data amounts. The successful candidate will be responsible for creating data platforms using typically provided infrastructure and establishing a clear path for...