Senior Data Engineer

2 miesięcy temu


Warszawa, Polska B2B.net S.A Pełny etat

Senior Data Engineer


Your responsibilities

  • Working with Spark & Python to define and maintain data ingestions and transformation
  • Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
  • Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
  • Working closely with analysts and business stakeholders to develop analytics models
  • Collaboration with Data Scientist and Machine Learning experts
  • Providing detailed information about progress during PI Demo sessions

Our requirements

  • Experience in Spark & Python - minimum 4 years
  • Strong Spark SQL or Hive SQL - minimum 4 years
  • Experience with Hadoop/Hive ecosystem and/or other BIG Data technologies - minimum 3 years
  • Previous experience in creating data flows (ETL's, ELT's, ect.)
  • Experience with BitBucket and GIT, code versioning and branching strategy
  • Familiar with Agile/Safe framework
  • Cloud Experience is a big plus (AWS, GCP, AZURE)
  • Basic knowledge about machine learning models (how to build, validate and maintenance regression models)
  • Scala /MLOPS experience

Aplikuj

 


  • Senior Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...

  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, mazowieckie, Polska Billennium Pełny etat

    As a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...

  • Senior Data Engineer

    3 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Our client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large...

  • Senior AWS Data Engineer

    4 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska Craftware Pełny etat

    Are you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...


  • Domaniewska , Warszawa, Polska emagine Polska Pełny etat

    Data Engineer (Azure Databricks) at emagine PolskaProject Overview:We are looking for a highly skilled Senior Azure Databricks Data Engineer to join our international Data team. The selected candidate will be responsible for designing, developing, and maintaining data pipelines in a scalable and performant manner.Responsibilities:Collaborate with an...


  • Warszawa, Polska HAYS Pełny etat

    Senior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...


  • Warszawa, Polska Jit Team Pełny etat

    About the RoleWe are seeking a skilled Data Engineer to join our team as a Senior Data Solutions Engineer. This role will involve designing, developing, and implementing big data solutions using Hadoop ecosystem.The ideal candidate will have expertise in Hadoop Cloudera distribution, proficiency in Docker and Kubernetes platforms, and strong knowledge of...

  • Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska Upvanta Pełny etat

    For our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...


  • Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Be part of a world leading company in the FMCG industry as a Senior Cloud Data Engineer. Our team is responsible for designing, developing and implementing data and analytics cloud-based platforms (DAP) and pipelines which acquire, cleanse, transform and publish data.We are looking for someone who can assemble large, complex data sets that meet functional...


  • Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etat

    We are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable...

  • Data Engineer Senior

    3 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Projekt dla firmy z branży konsultingowej. Klientem docelowym jest firma międzynarodowa, z Wielkiej Brytanii.Data Engineer Senior / ArchitectTwój zakres obowiązków Praca głównie z DataBricks Wizualizacja danych na potrzeby weryfikacji poprawności i testowanie...

  • Senior Data Engineer

    4 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Project for pharmacy sector - a key project in the field of creating Data Products and reporting solutions supporting decisions for organizations servicing diagnostic instruments.Senior Data Engineer (Snowflake)Your responsibilities Analyze and organize raw data. Build...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Job Title: Senior Data Engineer - Microsoft Azure ExpertAbout the Job:We are looking for a highly skilled Data Engineer to join our team at Procter and Gamble Polska Sp. z o.o. in Warsaw, Poland.Salary: Estimated salary range for this position is PLN 80,000 - 120,000 per month, depending on experience.Job Description: As a Data Engineer, you will be...

  • Senior Data Engineer

    1 tydzień temu


    Warszawa, Polska DCG Pełny etat

    DCG is a recruitment company that understands the importance of experienced professionals in driving business growth. Our unique management style and partnership approach enable us to deliver tailored solutions that meet our clients' needs.We are currently looking for a Senior Data Engineer with expertise in risk analytics to join our team. This role...


  • Warszawa, Polska Billennium Pełny etat

    Senior Data EngineerAs a Senior Data Engineer at Billennium, you will design and develop our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you will optimize data flows, enhance data quality, and support analytics and machine learning projects.Key Responsibilities:Build and...


  • Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Job Title: Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team at B2B S.A. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data ingestion and transformation pipelines using...

  • Senior Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etat

    Join our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...

  • Data Engineer

    2 miesięcy temu


    Warszawa, mazowieckie, Polska Billennium Pełny etat

    About the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...

  • Senior Big Data Engineer

    2 tygodni temu


    Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...