Senior Data Engineer
2 tygodni temu
Warszawa
Warsaw, Masovian Voivodeship, Polska
Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects .
Our team members tend to stick around for more than 3 years, and when a project wraps up, we don't let them go - we embark on a journey to discover exciting new challenges for them. It's not just a workplace; it's a community that grows together
What we expect:
Must-have:
● 4 years of commercial experience in Big Data
● proven record with a selected cloud provider: GCP preferred, Azure or AWS
● senior level knowledge of:
- programming language - Scala/Java/JVM
- distributed data processing - Spark or similar
- pipeline orchestration - Airflow or similar
- distributed datastore - BigQuery, Snowflake, Hive or similar
● designing and implementing Big Data systems following best practices
● good knowledge of Python
● ensuring solution quality through automatic tests, CI / CD and code review
● proven collaboration with businesses
● English proficiency at B2 level, communicative in Polish
Nice to have:
- experience in Snowflake/Databricks platform
- knowledge of Apache Kafka, Docker and Kubernetes technologies
- experience in Machine Learning projects
- experience in Flink
- willingness to share knowledge (conferences, articles, open-source projects)
- experience in leading a team or willingness to gain it - for the position of Team Leader
What's on offer:
- 100% remote work, with workation opportunity
- 20 free days
- onboarding with a dedicated mentor
- project switching possible after a certain period
- individual budget for training and conferences
- benefits: Medicover private medical care, co-financing of the Medicover Sport card
- opportunity to learn English with a native speaker
- regular company trips and informal get-togethers
Development opportunities in Datumo:
- participation in industry conferences
- establishing Datumo's online brand presence
- support in obtaining certifications (e. g. GCP, Azure, Snowflake)
- involvement in internal initiatives, like building technological roadmaps
- access to internal technological training repositories
Discover our exemplary projects:
IoT data ingestion to cloud
The project integrates data from edge devices into the cloud using Azure services. The platform supports data streaming via either the IoT Edge environment with Java or Python modules, or direct connection using Kafka protocol to Event Hubs. It also facilitates batch data transmission to ADLS. Data transformation from raw telemetry to structured tables is done through Spark jobs in Databricks or data connections and update policies in Azure Data Explorer.
Petabyte-scale data platform migration to Google Cloud
The goal of the project is to improve scalability and performance of the data platform by transitioning over a thousand active pipelines to GCP. The main focus is on rearchitecting existing Spark applications to either Cloud Dataproc or Cloud BigQuery SQL, depending on the Client's requirements and automate it using Cloud Composer.
Data analytics platform for investing company
The project centers on developing and overseeing a data platform for an asset management company focused on ESG investing. Databricks is the central component. The platform, built on Azure cloud, integrates various Azure services for diverse functionalities. The primary task involves implementing and extending complex ETL processes that enrich investment data, using Spark jobs in Scala. Integrations with external data providers, as well as solutions for improving data quality and optimizing cloud resources, have been implemented.
Realtime Consumer Data Platform
The initiative involves constructing a consumer data platform (CDP) for a major Polish retail company. Datumo actively participates from the project's start, contributing to planning the platform's architecture. The CDP is built on Google Cloud Platform (GCP), utilizing services like Pub/Sub, Dataflow and BigQuery. Open-source tools, including a Kubernetes cluster with Apache Kafka, Apache Airflow and Apache Flink, are used to meet specific requirements. This combination offers significant possibilities for the platform.
Recruitment process:
- Soft skills interview - 30 minutes
- Technical interview - 60 minutes
Find out more by visiting our website -
If you like what we do and you dream about creating this world with us - don't wait, apply now
Firma: Datumo
Dodano:
Praca na stanowisku - aktualna
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data...
-
Senior Data Engineer @
2 tygodni temu
Warszawa, Mazovia, Polska Sunscrapers Pełny etatSenior Data Engineer @ Sunscrapers Warsaw, Masovian Voivodeship Senior Data Engineer @ Sunscrapers Warszawa Warsaw, Masovian Voivodeship, Polska Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Sigma Software Pełny etatSenior Data Engineer (Internal Project) @ Sigma Software Warszawa Warsaw, Masovian Voivodeship, Polska Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMERSigma Software provides top-quality software development, graphic design, testing, and support services. Systems...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etatDla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcieSenior Data EngineerTwój zakres obowiązkówOdpowiedzialność za architekturę danych komenrcyjnych w Azure Rozwój modelu danych w chmurze na rzecz procesów BI w...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska LITE E-COMMERCE sp. z o.o. Pełny etatSenior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :PythonSQLtechnologies-optional :PubSubKafkaTerraformDockerabout-project :We are currently looking for a Senior Data Engineer, who will become Lite's hero or heroine in the mission of technological development of the worldresponsibilities :designing and building a...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska YourITeams Pełny etatWe are currently seeking a Senior Data Engineer to join our team! As a Senior Data Engineer, you will be responsible for creating and maintaining the infrastructure, tools, and processes necessary for our organization to handle large amounts of data effectively.This position offers the flexibility of remote work and is available on a contract...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Ecovadis Pełny etatSenior Data Engineer at EcoVadis We are seeking a Senior Data Engineer to be part of our expanding data platform unit at EcoVadis. Our team needs a skilled professional who can aid in the development and upkeep of data infrastructures and processing solutions crucial for our data scientists and internal data users. One of the core tasks involves building...
-
Senior Data Engineer
4 tygodni temu
Warszawa, Mazovia, Polska Reckitt Pełny etatAbout UsWe're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data driven thinkers to make it happen....
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Reckitt Pełny etatAbout UsWe're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data driven thinkers to make it happen....
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etatSenior Data Engineer Warszawa Warszawa, mazowieckie, Polska Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcie Twój zakres obowiązków Odpowiedzialność za architekturę danych komenrcyjnych w AzureRozwój modelu...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska ALTER SOLUTIONS Pełny etatJob Description The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Qualifications Minimum 4 years (senior) of experience working with ETL , ...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Alter Solutions Pełny etatJob DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Alter Solutions Group Pełny etatThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting.The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4years (senior) of experience working with ETL, data modeling, and data...
-
Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska DATA MART Consulting GmbH Pełny etatOverview:SOFTSWISS continues to expand the team and is looking for a middle Data Engineer. We need a true, experienced, and accomplished professional who shares our culture and values.Key responsibilities:Design, construct, install, test, and maintain datasets for the team, ensuring data availability and accessibility Assist in the design and maintenance of...
-
Senior Data Engineer @
2 tygodni temu
Warszawa, Mazovia, Polska Capgemini Polska Sp. Z O.o. Pełny etatSenior Data Engineer Capgemini Engineering is a world leader in engineering and R& D services.We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds.Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are a...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Circle K Business Centre Pełny etatThe Senior Data Engineer will be pivotal in creating data exchange interfaces for critical business applications within the global fuels logistic processes. This role will involve technical proficiency in developing and maintaining ETL processes the same as strategic thinking in terms of architecture and overall project ownership.This is an exciting...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatSenior Data Engineer (GCP) @ GetInData | Part of Xebia Warsaw, Masovian Voivodeship Senior Data Engineer (GCP) @ GetInData | Part of Xebia Warszawa Warsaw, Masovian Voivodeship, Polska A Data Engineer's role involves crafting, constructing, and upholding the structure, tools, and procedures essential for an organization to gather, store, modify, and...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska HCLTech Pełny etatSenior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska Responsibilities• Partner with leadership, engineers, program managers and data scientists to understand data needs.• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time...
-
Senior Data Engineer z
2 tygodni temu
Warszawa, Mazovia, Polska dmTECH Polska Pełny etatSenior Data Engineer z j.niemieckim Warszawa, mazowieckie Senior Data Engineer z j.niemieckim Warszawa Warszawa, Województwo mazowieckie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Digital Turbine Pełny etatSenior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...
