Senior Data Platform Engineer
6 dni temu
We are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable data architectures based on business needs and work closely with stakeholders to offer technical insights for ongoing and future data platform initiatives.
Senior Data Platform Engineer (Python)
Your responsibilities
- Design and optimize data ingestion systems to ensure a consistent flow of high-quality data into the platform, creating a solid foundation for developing data products and supporting comprehensive KPI tracking and analysis.
- Demonstrate expertise in Infrastructure as Code (IaC), utilizing tools like Terraform or CloudFormation to automate infrastructure deployment and management.
- Translate business requirements into robust technical architecture, including designing physical schema and logical data models.
- Engage with stakeholders to understand their needs, providing technical guidance for current and future data platform projects.
- Analyze user interaction with the data platform, focusing on patterns of use to identify areas for improvement and optimize user engagement over time.
- Implement and maintain data governance frameworks, emphasizing automated processes for data quality checks, compliance adherence, and secure data handling, while collaborating with engineering teams to integrate governance protocols into data pipelines and platform architecture.
- Participate actively in all Data Platform Engineering team meetings and knowledge-sharing sessions, contributing to team learning and process improvement.
Our requirements
- Expertise in AWS services, especially Glue, Athena, EMR, EC2, IAM, MWAA
- Proficiency in Python and PySpark
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
- Experience in implementing data contracts
- Experience in applying data governance policies
- Experience with data quality frameworks (Great expectations, Soda)
- Familiarity with the data mesh architecture and its principles
- Django experience
- Important: Strong Python knowledge
What we offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
Aplikuj
-
Senior Azure Data Platform Engineer
6 dni temu
Warszawa, Polska HAYS POLAND Sp. z o.o. Pełny etatSenior Azure Data Platform Engineer lokalizacja: Warszawa (mazowieckie) numer referencyjny: 1189893/jobs.pl forma zatrudnienia: Pełny etat Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, Warsaw Your Tasks: - Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. - Designing and managing database schemas to...
-
Senior Azure Data Platform Engineer
6 dni temu
Warszawa, Polska HAYS Pełny etatSenior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...
-
Senior Data Architect
6 dni temu
Warszawa, Mazovia, Polska Intuition Machines, Inc. Pełny etat**Job Description**We are seeking a seasoned Senior Data Engineer to join our team. The ideal candidate will work closely with ML engineers and researchers to build datasets on demand, influence data storage and processing strategies, and collaborate with various teams to enhance our data platform.
-
Senior Data Engineer
2 dni temu
Warszawa, Polska HAYS POLAND Sp. z o.o. Pełny etatSenior Data Engineer (.NET, Azure) lokalizacja: Warszawa (mazowieckie) numer referencyjny: 1191131/jobs.pl forma zatrudnienia: Pełny etat Your new company: You will join a global company known for its pharmaceutical business, which also carries out projects for the agriculture sector. As a Senior Data Engineer, you will be a part of the company's...
-
Data Platform Architect
6 dni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat**Job Description**A Senior Data Engineer plays a pivotal role in designing and constructing robust data architectures. This position involves crafting tools and procedures to facilitate the collection, storage, manipulation, and analysis of large data volumes. The ideal candidate will have expertise in erecting data platforms atop provided infrastructure...
-
Senior Data Engineer
3 dni temu
Warszawa, Polska HAYS Pełny etatSenior Data Engineer (.NET, Azure)WarszawaNR REF.: 1191131Your new company: You will join a global company known for its pharmaceutical business, which also carries out projects for the agriculture sector.As a Senior Data Engineer, you will be a part of the company39s global agriculture business. You will work on implementing an open agronomic platform...
-
Platform Development Engineer
4 dni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatJob Description:We are seeking a highly skilled Senior Platform Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining core infrastructure supporting various software applications and services. Collaborating across diverse teams, including software developers, data engineers, IT...
-
Mid Senior DevOps Engineer – Data Platform
2 dni temu
Warszawa, mazowieckie, Polska SimCorp Pełny etatWho we are For over 50 years, we have worked closely with investment and asset managers to become the world’s leading provider of integrated investment management solutions. We are 3,000+ colleagues with a broad range of nationalities, educations, professional experiences, ages, and backgrounds. SimCorp is an independent subsidiary of the Deutsche...
-
Data Platform Engineer
4 dni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatCompany Overview:GetInData, part of Xebia, is a dynamic organization that offers an innovative work environment. We are seeking a skilled Data Engineer to join our team and contribute to the development of our data infrastructure.
-
Data Engineer Lead
18 godzin temu
Warszawa, Mazovia, Polska Spyrosoft Pełny etat**About Spyrosoft**We're a cutting-edge fintech company based in Warsaw, collaborating with global industry leaders to drive innovation in digital payment solutions.Our team is looking for top-tier engineers who thrive in dynamic, forward-thinking environments. We value independence, proactiveness, and flexibility.As a Senior/Lead Data Engineer @ Spyrosoft,...
-
Azure Data Platform Expert
6 dni temu
Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etatAbout the Role:We are looking for a Senior Azure Data Platform Engineer to join our Hays Poland Sp. z o.o. team in Warsaw. In this role, you will be responsible for managing and optimizing Data/AI workflows using AI orchestrators like LangChain. You will also design and manage database schemas to efficiently meet application data...
-
Senior Data Specialist
2 dni temu
Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etatJob Description:">We are seeking a highly skilled Senior Data Engineer to join our team in Warsaw. As a key member of our global agriculture business, you will be responsible for implementing our data strategy and driving data governance to ensure data standardization on our platform.">Key Responsibilities:">">Develop data management concepts, including data...
-
Senior Cloud Data Engineer
4 dni temu
Warszawa, Mazovia, Polska hubQuest Pełny etatOverviewHubQuest is a leading player in the data-driven decision-making space, with a global analytics unit that strengthens business outcomes through innovative smart data products. As a Senior Azure MLOps Engineer, you will be part of a diverse collective of professionals driving collaboration, innovation, and reliability across three continents and five...
-
Data Engineer Lead
2 dni temu
Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etatAbout the Role:">We are seeking a highly skilled Senior Data Engineer to join our team in Warsaw. As a key member of our global agriculture business, you will be responsible for implementing our data strategy and driving data governance to ensure data standardization on our platform.">Key Responsibilities:">">Develop data management concepts, including data...
-
Senior Big Data Engineer
7 dni temu
Warszawa, Mazovia, Polska Experis Manpower Group Pełny etatJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at Experis Manpower Group. About the RoleThe ideal candidate will have extensive experience in designing, developing, and optimizing scalable data pipelines using Databricks and Apache Spark. You will be responsible for building and maintaining ETL workflows to process...
-
Data Platform Engineer, Digital Experiences
6 dni temu
Warszawa, Polska Procter And Gamble Polska Sp. z o.o. Pełny etatData Platform Engineer, Digital Experiences47_R000108298Obowiązki Work as a key member of a multi-disciplinary product team including engineers, product managers, and designers delivering innovative digital solutions following Agile & DevOps best practices.Drive the development and implementation of tools and automations that help scale data...
-
Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etatJob DescriptionWe are seeking a highly skilled Data Platform Engineer to join our team at Procter and Gamble Polska Sp. z o.o.Company OverviewAs a key member of our product team, you will be responsible for delivering innovative digital solutions following Agile and DevOps best practices.Key Responsibilities:Develop and implement tools and automations that...
-
Senior Data Engineer
5 dni temu
Warszawa, mazowieckie, Polska Alter Solutions Polska Pełny etatCompany DescriptionOur mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying...
-
Senior Data Engineer
6 dni temu
Warszawa, Polska B2B.net S.A Pełny etatSenior Data EngineerYour responsibilities Working with Spark & Python to define and maintain data ingestions and transformation Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured...
-
Senior Data Platform Developer
6 dni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatJob DescriptionWe are looking for an experienced Data Engineer to craft and maintain the structure, tools, and procedures essential for gathering, storing, modifying, and scrutinizing extensive data amounts. The successful candidate will be responsible for creating data platforms using typically provided infrastructure and establishing a clear path for...