Senior Data Engineer
2 miesięcy temu
Senior Data Engineer
Your responsibilities
- Working with Spark & Python to define and maintain data ingestions and transformation
- Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
- Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
- Working closely with analysts and business stakeholders to develop analytics models
- Collaboration with Data Scientist and Machine Learning experts
- Providing detailed information about progress during PI Demo sessions
Our requirements
- Experience in Spark & Python - minimum 4 years
- Strong Spark SQL or Hive SQL - minimum 4 years
- Experience with Hadoop/Hive ecosystem and/or other BIG Data technologies - minimum 3 years
- Previous experience in creating data flows (ETL's, ELT's, ect.)
- Experience with BitBucket and GIT, code versioning and branching strategy
- Familiar with Agile/Safe framework
- Cloud Experience is a big plus (AWS, GCP, AZURE)
- Basic knowledge about machine learning models (how to build, validate and maintenance regression models)
- Scala /MLOPS experience
Aplikuj
-
Senior Big Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatJob Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatOur client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large...
-
Senior AWS Data Engineer
4 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatWe are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Senior Azure Databricks Data Engineer
1 tydzień temu
Domaniewska , Warszawa, Polska emagine Polska Pełny etatData Engineer (Azure Databricks) at emagine PolskaProject Overview:We are looking for a highly skilled Senior Azure Databricks Data Engineer to join our international Data team. The selected candidate will be responsible for designing, developing, and maintaining data pipelines in a scalable and performant manner.Responsibilities:Collaborate with an...
-
Senior Azure Data Platform Engineer
2 miesięcy temu
Warszawa, Polska HAYS Pełny etatSenior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...
-
Senior Data Solutions Engineer
2 tygodni temu
Warszawa, Polska Jit Team Pełny etatAbout the RoleWe are seeking a skilled Data Engineer to join our team as a Senior Data Solutions Engineer. This role will involve designing, developing, and implementing big data solutions using Hadoop ecosystem.The ideal candidate will have expertise in Hadoop Cloudera distribution, proficiency in Docker and Kubernetes platforms, and strong knowledge of...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Senior Cloud Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etatBe part of a world leading company in the FMCG industry as a Senior Cloud Data Engineer. Our team is responsible for designing, developing and implementing data and analytics cloud-based platforms (DAP) and pipelines which acquire, cleanse, transform and publish data.We are looking for someone who can assemble large, complex data sets that meet functional...
-
Senior Data Platform Engineer
2 miesięcy temu
Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable...
-
Data Engineer Senior
3 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatProjekt dla firmy z branży konsultingowej. Klientem docelowym jest firma międzynarodowa, z Wielkiej Brytanii.Data Engineer Senior / ArchitectTwój zakres obowiązków Praca głównie z DataBricks Wizualizacja danych na potrzeby weryfikacji poprawności i testowanie...
-
Senior Data Engineer
4 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatProject for pharmacy sector - a key project in the field of creating Data Products and reporting solutions supporting decisions for organizations servicing diagnostic instruments.Senior Data Engineer (Snowflake)Your responsibilities Analyze and organize raw data. Build...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etatJob Title: Senior Data Engineer - Microsoft Azure ExpertAbout the Job:We are looking for a highly skilled Data Engineer to join our team at Procter and Gamble Polska Sp. z o.o. in Warsaw, Poland.Salary: Estimated salary range for this position is PLN 80,000 - 120,000 per month, depending on experience.Job Description: As a Data Engineer, you will be...
-
Senior Data Engineer
1 tydzień temu
Warszawa, Polska DCG Pełny etatDCG is a recruitment company that understands the importance of experienced professionals in driving business growth. Our unique management style and partnership approach enable us to deliver tailored solutions that meet our clients' needs.We are currently looking for a Senior Data Engineer with expertise in risk analytics to join our team. This role...
-
Data Engineer for Scalable Infrastructure
4 tygodni temu
Warszawa, Polska Billennium Pełny etatSenior Data EngineerAs a Senior Data Engineer at Billennium, you will design and develop our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you will optimize data flows, enhance data quality, and support analytics and machine learning projects.Key Responsibilities:Build and...
-
Senior Data Engineering Leader
2 tygodni temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatJob Title: Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team at B2B S.A. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data ingestion and transformation pipelines using...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etatJoin our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAbout the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...
-
Senior Big Data Engineer
2 tygodni temu
Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etatJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...