Senior Data Engineer

4 tygodni temu


Warszawa, Polska B2B.net S.A Pełny etat

Senior Data Engineer


Your responsibilities

  • Working with Spark & Python to define and maintain data ingestions and transformation
  • Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
  • Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
  • Working closely with analysts and business stakeholders to develop analytics models
  • Collaboration with Data Scientist and Machine Learning experts
  • Providing detailed information about progress during PI Demo sessions

Our requirements

  • Experience in Spark & Python - minimum 4 years
  • Strong Spark SQL or Hive SQL - minimum 4 years
  • Experience with Hadoop/Hive ecosystem and/or other BIG Data technologies - minimum 3 years
  • Previous experience in creating data flows (ETL's, ELT's, ect.)
  • Experience with BitBucket and GIT, code versioning and branching strategy
  • Familiar with Agile/Safe framework
  • Cloud Experience is a big plus (AWS, GCP, AZURE)
  • Basic knowledge about machine learning models (how to build, validate and maintenance regression models)
  • Scala /MLOPS experience

Aplikuj

 



  • Warszawa, Mazovia, Polska NTT DATA Pełny etat

    Job DescriptionWe are seeking a seasoned system expert to join our team as a Senior Windows Infrastructure Engineer. This role is critical in designing and implementing information systems that support our enterprise infrastructure.About the RoleThis position ensures that all systems are working at optimal levels and supports the development of new...

  • Senior Data Engineer

    1 miesiąc temu


    Emilii Plater , Warszawa, Polska BEC Poland Pełny etat

    Senior Data Engineer - DWH SolutionsWe are seeking an experienced Senior Data Engineer to join our team at BEC Poland, working closely with Nykredit. As a Senior Data Engineer, you will be responsible for designing and implementing ETL processes, optimizing data loading to the DWH, and performing daily maintenance tasks.Key Responsibilities:Participate in...

  • Senior Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Billennium Pełny etat

    As a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...


  • Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat

    **About the Role**Balyasny Asset Management L.P. is seeking a skilled Senior Data Quality Engineer to join our team.As a Senior Data Quality Engineer, you will be responsible for designing and developing solutions that leverage cloud-based data and distributed computing technologies to create our next-gen data quality platform.You will contribute...

  • Senior ML Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Square One Resources Sp. z o.o. is seeking a Senior ML Engineer - Biomedical Data Insights to join our team.As a Senior ML Engineer, you will design, develop, and deploy solutions based on large language models (LLM) for secondary use and primary exploration of biomedical data. Your responsibilities will include:Fine-tuning LLM models to meet specific...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etat

    About the Role:As a Senior Data Engineer at Sunscrapers, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from various sources.Key Responsibilities:Design and implement data collection systems that integrate proprietary company data and third-party...

  • Senior Data Architect

    1 miesiąc temu


    Warszawa, Mazovia, Polska emagine Consulting Pełny etat

    Job OverviewWe are seeking a Senior Data Engineer to join our team in the data platforms and services department. The ideal candidate will have a strong background in databases, data modeling, and data warehousing.The Senior Data Engineer will be responsible for providing Business Intelligence Foundation and backend solutions components. This includes...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, Polska Tangome Poland Sp. z o.o. Pełny etat

    Unlock the Potential of Big Data as a Senior Data EngineerTangome Poland Sp. z o.o., a pioneering live-streaming platform, is seeking an exceptional Senior Data Engineer to join our team in Poland.We are a forward-thinking organization with 500+ million registered users and a projected market value of $240 billion. Our platform empowers talented individuals...


  • Warszawa, Mazovia, Polska Siemens Healthcare Sp. z o.o. Pełny etat

    Job DescriptionSiemens Healthineers is a leading healthcare company that innovates solutions for diagnostics, therapy and personalized healthcare. We are seeking an experienced Senior Data Transformation Engineer to join our team in Poland.About the RoleThis role offers a unique opportunity to work with cutting-edge technology and contribute to the...

  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Our client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large...

  • Senior AWS Data Engineer

    3 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska IT Performance Pełny etat

    Praca Senior Data Engineer w IT PerformanceW IT Performance poszukujemy kandydatów na stanowisko Senior Data Engineer. Niniejsze stanowisko dedykowane jest międzynarodowej firmie specjalizującej się w technologii medycznej i farmacji, z obszarem danych.ObowiązkiProjektowanie, rozwijanie i utrzymywanie solidnych, skalowalnych i wydajnych Data/ETL...

  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, Mazovia, Polska VGW Pełny etat

    Senior Data Engineer - Game DevelopmentWe are seeking a highly skilled Senior Data Engineer to join our team in Poland. As a key member of our Growth team, you will be responsible for integrating new games into our existing systems, ensuring a seamless experience for our players.Tech We UseOur current analytics stack includes Snowflake, Databricks, AWS...

  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Job Description:Square One Resources Sp. z o.o. is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines using Snowflake.Key Responsibilities:Analyze and organize raw data to extract insights and inform business...

  • Senior AWS Data Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are looking for a skilled Senior Data Engineer to work on a groundbreaking project.Key Responsibilities:Design and implement ETL processes for efficient data flow and storage. Maintain and optimize data pipelines using cloud technologies. Collaborate with cross-functional teams to integrate and process biomedical data. Ensure data quality and adherence to...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, Mazovia, Polska Siemens Healthcare Sp. z o.o. Pełny etat

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our internal data conversion team at Siemens Healthineers. In this role, you will design, develop, and maintain complex data transformation processes to ensure the accuracy, efficiency, and security of our data operations. Your expertise in SQL, Python,...


  • Marszałkowska , Warszawa, Polska Asana Pełny etat

    Build Asana's Data PlatformsAs a senior software engineer on Asana's Data Infrastructure team, you will design and implement production code for backend, infrastructure, and data systems. You will help build the company's data platforms for a world-class team of engineers.Key ResponsibilitiesDesign and implement production code for backend,...


  • Warszawa, Polska HAYS Pełny etat

    Senior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...


  • Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Data Quality Engineer to join our team at Balyasny Asset Management L.P.The ideal candidate will have a strong background in software engineering, data quality, and cloud-native technologies. This is an excellent opportunity to work on a high-impact project that requires expertise in designing and...

  • Senior Data Engineer

    3 tygodni temu


    Warszawa, Polska N-iX Pełny etat

    Role OverviewWe are seeking a seasoned Senior Data Engineer to join our team at N-iX. As a key member of our engineering group, you will be responsible for designing, building, and maintaining production-grade data pipelines using Python.This is an excellent opportunity to work with a leading SaaS provider that specializes in developing solutions for...