Senior Data Engineer
2 tygodni temu
Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects .
Our team members tend to stick around for more than 3 years, and when a project wraps up, we don't let them go - we embark on a journey to discover exciting new challenges for them. It's not just a workplace; it's a community that grows together
What we expect:
Must-have:
● 4 years of commercial experience in Big Data
● proven record with a selected cloud provider: GCP (preferred), Azure or AWS
● senior level knowledge of:
- programming language - Scala or Python
- distributed data processing - Spark or similar
- pipeline orchestration - Airflow or similar
- distributed datastore - BigQuery, Snowflake, Hive or similar
● designing and implementing Big Data systems following best practices
● ensuring solution quality through automatic tests, CI / CD and code review
● proven collaboration with businesses
● English proficiency at B2 level, communicative in Polish
Nice to have:
- experience in Snowflake/Databricks platform
- knowledge of Apache Kafka, Docker and Kubernetes technologies
- experience in Machine Learning projects
- willingness to share knowledge (conferences, articles, open-source projects)
- experience in leading a team or willingness to gain it - for the position of Team Leader
What's on offer:
- 100% remote work, with workation opportunity
- 20 free days
- onboarding with a dedicated mentor
- project switching possible after a certain period
- individual budget for training and conferences
- benefits: Medicover private medical care, co-financing of the Medicover Sport card
- opportunity to learn English with a native speaker
- regular company trips and informal get-togethers
Development opportunities in Datumo:
- participation in industry conferences
- establishing Datums online brand presence
- support in obtaining certifications (e. g. GCP, Azure, Snowflake)
- involvement in internal initiatives, like building technological roadmaps
- access to internal technological training repositories
Discover our exemplary projects:
IoT data ingestion to cloud
The project integrates data from edge devices into the cloud using Azure services. The platform supports data streaming via either the IoT Edge environment with Java or Python modules, or direct connection using Kafka protocol to Event Hubs. It also facilitates batch data transmission to ADLS. Data transformation from raw telemetry to structured tables is done through Spark jobs in Databricks or data connections and update policies in Azure Data Explorer.
Petabyte-scale data platform migration to Google Cloud
The goal of the project is to improve scalability and performance of the data platform by transitioning over a thousand active pipelines to GCP. The main focus is on rearchitecting existing Spark applications to either Cloud Dataproc or Cloud BigQuery SQL, depending on the Client's requirements and automate it using Cloud Composer.
Data analytics platform for investing company
The project centers on developing and overseeing a data platform for an asset management company focused on ESG investing. Databricks is the central component. The platform, built on Azure cloud, integrates various Azure services for diverse functionalities. The primary task involves implementing and extending complex ETL processes that enrich investment data, using Spark jobs in Scala. Integrations with external data providers, as well as solutions for improving data quality and optimizing cloud resources, have been implemented.
Realtime Consumer Data Platform
The initiative involves constructing a consumer data platform (CDP) for a major Polish retail company. Datumo actively participates from the project's start, contributing to planning the platform's architecture. The CDP is built on Google Cloud Platform (GCP), utilizing services like Pub/Sub, Dataflow and BigQuery. Open-source tools, including a Kubernetes cluster with Apache Kafka, Apache Airflow and Apache Flink, are used to meet specific requirements. This combination offers significant possibilities for the platform.
Recruitment process:
- Soft skills interview - 30 minutes
- Technical interview - 60 minutes
Find out more by visiting our website -
If you like what we do and you dream about creating this world with us - don't wait, apply now
Firma: Datumo
Dodano:
Praca na stanowisku - aktualna
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Lite e-Commerce Pełny etatSenior Data Engineer Gdańsk, Pomeranian Voivodeship Senior Data Engineer Gdańsk Gdańsk, Pomeranian Voivodeship, Polska Informacje: Lokalizacja: Gdańsk Gdańsk, Pomeranian Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Gdańsk - Ciekawe oferty pracy w okolicy:GdańskOferty pracy w okolicznych lokalizacjachGdańsk: Inne oferty pracy w...
-
Process Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska The Chemical Engineer Pełny etatThales people architect identity management and data protection solutions at the heart of digital security. Business and governments rely on us to bring trust to the billons of digital interactions they have with people. Our technologies and services help banks exchange funds, people cross borders, energy become smarter and much more. More than 30,000...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Rite NRG Pełny etatSenior Data Engineer Gdańsk, Województwo pomorskie Senior Data Engineer Gdańsk Gdańsk, Pomeranian Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska j-labs Pełny etatSenior Data Engineer Gdańsk, Województwo pomorskie Senior Data Engineer Gdańsk Gdańsk, Pomeranian Voivodeship, Polska Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala...
-
Senior Data Engineer z jniemieckim
2 tygodni temu
Gdańsk, Pomerania, Polska dmTECH Polska Pełny etatSenior Data Engineer z jniemieckim Gdańsk, Województwo pomorskie Senior Data Engineer z jniemieckim Gdańsk Gdańsk, Pomeranian Voivodeship, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Sunscrapers Pełny etatAdvance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Ciklum Pełny etatDescription Ciklum is looking for a Senior Data Engineer (Databricks and Spark) to join our team full-time in Poland. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants,...
-
Senior Big Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.Senior Big Data EngineerYour responsibilitiesDesign and...
-
Senior Data Engineer z j. niemieckim
2 tygodni temu
Gdańsk, Pomerania, Polska dmTECH Polska Pełny etatSenior Data Engineer z j.niemieckim Gdańsk, Województwo pomorskie Senior Data Engineer z j.niemieckim Gdańsk Gdańsk, Województwo pomorskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Arla Global Shared Services Sp. Z O.o. Pełny etatTechnologies-expected : SQL Python R Azure no-SQL Databricks Scala Azure Dev Ops about-project : Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? Join our...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Arla foods Pełny etatAbout the jobJoining our commercial IT team is a great opportunity, as this area is currently experiencing significant growth and activity. As a Senior Data Engineer, your main responsibility will be to support the ongoing development and enhancement of our global Data Foundation presence on Microsoft Azure and other platforms.The role involves:Executing...
-
Senior Data Engineer to work with Big Data
4 dni temu
Gdańsk, Pomerania, Polska Nordea Bank Pełny etatJob ID: 25161 #IT #Developer #Data #EngineeringWould you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea's next generation Big Data Platform.In Nordea, we're harnessing the power of technology to reinvent the future of banking. A tech revolution is underway –...
-
Senior Data Engineer
1 tydzień temu
Gdańsk, Pomerania, Polska Arla Global Shared Services Sp. z o.o. Pełny etattechnologies-expected :SQLPythonRno-SQLDatabricksScalaabout-project :Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing?Join our commercial IT organization, which...
-
Senior PHP Developer
2 tygodni temu
Gdańsk, Pomerania, Polska Transparent Data Pełny etatSenior PHP Developer Gdańsk, Pomeranian Voivodeship Senior PHP Developer Gdańsk Gdańsk, Pomeranian Voivodeship, Polska Transparent Data to unikalna kombinacja mocnej technologii i doświadczenia w pracy z danymi. Wykorzystujemy dane z otwartych rejestrów dotyczących danych gospodarczych by dostarczać usługi i produkty dla klientów biznesowych....
-
Senior Data Engineer
4 tygodni temu
Gdańsk, Pomerania, Polska Arla Foods Pełny etatDo you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the jobJoin our commercial IT organization, which is an area that benefits from an increased focus and...
-
Senior Data Engineer
1 miesiąc temu
Gdańsk, Pomerania, Polska Arla Foods Pełny etatDo you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the jobJoin our commercial IT organization, which is an area that benefits from an increased focus and...
-
Senior Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Arla Foods Deutschland GmbH Pełny etatSelect how often (in days) to receive an alert: Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the job Join our commercial IT organization,...
-
Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska MindPal Pełny etatData Engineer (Snowflake)Miejsce pracy: Gdańsk Technologies we use Expected SQL Python About the project We are looking for a Data Engineer (Snowflake) to join the team at Mind Pal, working for our key client in the technology sector.We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals,...
-
Senior Software Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Link Group Pełny etatRequirementsOver 5 years of experience as a Senior Software Engineer specializing in Python, Node. js, and MongoDB. Extensive expertise in Python, particularly in data manipulation and analysis using libraries like NumPy and Pandas. Proficiency in Node. js and building RESTful APIs. Experience with MongoDB or other NoSQL databases. Strong understanding of...
-
Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska MindPal Pełny etatExpected, SQL, PythonAbout the project, We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative solutions,...
