Big Data Engineering Lead

1 miesiąc temu


Warszawa, Mazovia, Polska B2B S.A Pełny etat

Senior Data Engineer

Your Key Responsibilities:

  • Data Ingestion and Transformation: Collaborate with cross-functional teams to design, develop, and maintain large-scale data ingestion and transformation processes using Spark and Python.
  • Distributed Data Processing: Build high-performance, parallelized big data processing pipelines to process massive amounts of structured and unstructured data in near real-time using Spark.
  • Data Enrichment and Analytics: Leverage Spark to enrich and transform corporate data, enabling searching, data visualization, and advanced analytics for business stakeholders.
  • Collaboration and Stakeholder Engagement: Work closely with analysts, business stakeholders, and data scientists to develop analytics models and provide regular progress updates during PI Demo sessions.

Requirements and Expectations:

  • Technical Expertise: Minimum 4 years of experience in Spark & Python, strong knowledge of Spark SQL or Hive SQL, and expertise in Hadoop/Hive ecosystem and/or other BIG Data technologies.
  • Data Flow Experience: Proven track record of creating data flows (ETL's, ELT's) and experience with BitBucket and GIT, code versioning, and branching strategies.
  • Agile Methodologies: Familiarity with Agile/Safe framework and basic understanding of machine learning models, including how to build, validate, and maintain regression models.
  • Cloud and MLOPS: Cloud experience (AWS, GCP, AZURE) and Scala/MLOPS experience a plus.

Estimated Salary: €80,000 - €110,000 per year, depending on location and experience.


  • Senior Big Data Engineer

    2 tygodni temu


    Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...


  • Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    We are seeking a highly skilled Hadoop Administrator to join our client team on a B2B contract basis.This is an exciting opportunity to work with a multinational client headquarted in the US and a leader in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.Job Opportunity: Hadoop...

  • Data Engineering Lead

    3 tygodni temu


    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    At Square One Resources Sp. z o.o., we are seeking a seasoned Data Engineering Lead to spearhead the development of our blockchain crypto solution. Key Responsibilities:Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks.Implement data orchestration workflows using Airflow or similar tools.Manage and optimize data...

  • Data Science Project Lead

    4 tygodni temu


    Warszawa, Mazovia, Polska Addepto Pełny etat

    Job Title: Data Science Project LeadWe are seeking a skilled Data Science Project Lead to oversee our data science and big data projects. As a member of our team, you will be responsible for managing projects from start to finish, ensuring timely delivery and exceeding client expectations.About the RoleThis is an exciting opportunity to work with a team of...


  • Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Job Title: Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team at B2B S.A. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data ingestion and transformation pipelines using...

  • Senior Big Data Architect

    2 tygodni temu


    Warszawa, Mazovia, Polska Jit Team Pełny etat

    **Job Description:**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will work with the Hadoop ecosystem to develop and manage big data solutions.**Key Responsibilities:**Develop and manage big data solutions using Hadoop ecosystemSet up CI/CD pipelines and work with Docker and Kubernetes platformsManage relational...


  • Warszawa, Mazovia, Polska Datumo Pełny etat

    Role Overview">We are seeking an experienced Big Data Solutions Architect to join our team at Datumo. As a key member of our technical team, you will play a crucial role in designing and implementing scalable data solutions for our clients.

  • Big Data Expert

    1 tydzień temu


    Warszawa, Mazovia, Polska Datumo Pełny etat

    Unlock Your Potential as a Big Data ExpertAre you passionate about driving innovation and growth in the field of big data? Do you have a strong background in Java and a desire to transition into the exciting world of big data?About DatumoDatumo is a leading provider of big data and cloud consulting services, serving clients across Western Europe, Poland, and...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    We are seeking a highly skilled Big Data Analysis Platform Developer to join our team in Poland. This is an exciting opportunity to contribute to the development of an advanced Big Data analysis platform utilizing Hadoop, Scala/Spark, and HDFS technologies.Job DescriptionThis project focuses on creating a cutting-edge Big Data analysis platform that manages...

  • Data Science Team Lead

    4 tygodni temu


    Warszawa, Mazovia, Polska RTB House Pełny etat

    Job DescriptionWe are seeking an experienced Data Science Team Lead to join our team at RTB House.About UsRTB House is a data-driven company that leads in programmatic advertising. We work with thousands of clients worldwide, serving over 15 million queries per second and generating petabytes of data.Job SummaryThe successful candidate will be responsible...

  • Big Data Expert

    2 tygodni temu


    Warszawa, Mazovia, Polska Datumo Pełny etat

    Company OverviewDatumo is a renowned Big Data and Cloud consulting services provider, serving clients globally with a strong presence in Western Europe, Poland, and the USA. Our core industries include e-commerce, telecommunications, and life science. We pride ourselves on an exceptional team of committed professionals, enabling us to undertake highly...

  • Data Engineering Lead

    3 tygodni temu


    Warszawa, Mazovia, Polska Experis Manpower Group Pełny etat

    OverviewWe are seeking a skilled Data Engineer to join our team in a remote work environment. This role focuses on developing data pipelines and managing Spark clusters.

  • Data Center Project Lead

    2 tygodni temu


    Warszawa, Mazovia, Polska Green Capital S.A. Pełny etat

    OverviewGreen Capital S.A. is a pioneering company in the renewable energy sector, seeking an experienced Data Center Project Lead to oversee the successful delivery of data center projects from inception to completion.Estimated Salary€80,000 - €100,000 per year, depending on experience and qualifications.Job DescriptionWe are looking for a skilled...


  • Warszawa, Mazovia, Polska B2B S.A Pełny etat

    We are looking for an experienced Data Engineer at B2B S.A. to enhance group risk reporting through the development of new data pipelines and optimization of existing ones.Key ResponsibilitiesRemodel and aggregate data inputs into a common formatIntegrate diverse data sources and build analytics pipelinesConduct work on a common big data platform using...


  • Warszawa, Mazovia, Polska Mindbox S.A. Pełny etat

    Reliability Engineering Leadership OpportunityMindbox S.A. is seeking an experienced Senior Reliability Engineering Lead to spearhead the development of our Site Reliability Engineering (SRE) team.About the Role:This critical position will oversee a squad of skilled engineers, driving operational excellence across our product squads and microservices-based...


  • Warszawa, Mazovia, Polska Datumo Pełny etat

    About DatumoDatumo is a leading Big Data and Cloud consulting services provider, serving clients globally, particularly in Western Europe, Poland, and the USA. Our core industries include e-commerce, telecommunications, and life science.Our team boasts exceptional individuals committed to delivering high-demanding projects. Team members tend to stay for more...


  • Warszawa, Mazovia, Polska Experis Manpower Group Pełny etat

    Experis Manpower Group Job DescriptionJob Title: Data Solutions ArchitectLocation: Remote (100% remote work)About the RoleWe are seeking an experienced Data Solutions Architect to join our team at Experis Manpower Group. The ideal candidate will have a strong background in big data technologies and a passion for building scalable data...


  • Warszawa, Mazovia, Polska Onwelo Sp. Z O.o. Pełny etat

    Oferta pracyZnajdziesz się wśród miejsca pracy o przełomowej roli, jako Inżynier Big Data w Onweloo Sp. Z O.o.Oferujemywygodną formę zatrudnienia,możliwość korzystania z elastycznych godzin pracy,zdalne pracę, zaoszczędzenie czasu na dojazdach.Dodatkowe atutypraca w atrakcyjnie zlokalizowanym biurze,szeroki dostęp do szkoleń wewnętrznych i...


  • Warszawa, Mazovia, Polska PROVIDENT Polska Pełny etat

    We are seeking a highly skilled Senior Software Engineering Lead to join our team at PROVIDENT Polska. As a leader, you will be responsible for the technical management of external suppliers and internal resources, ensuring that our Scrum team adheres to technical designs, development standards, and best practices.Our ideal candidate will have experience...


  • Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    At Square One Resources Sp. z o.o., we are seeking a highly skilled Lead Data Infrastructure Engineer to join our team. ">Job Description:We are looking for an experienced Senior Data Architecture Specialist to lead the design and implementation of our data architecture solutions.About the Role:The successful candidate will have 4+ years of experience...