Aktualne oferty pracy związane z Big Data Engineer, Warsaw - Warszawa, Mazovia - TN Poland

  • Big Data

    3 dni temu

    Warszawa, Mazovia, Polska ITMAGINATION Sp. z o. o. Pełny etat

    We're hiring a Big Data & Cloud Developer (Hybrid work from Warsaw, Poland) at ITMAGINATION, join our team of 400+ developers, analysts and testers ITMAGINATION helps its Clients by becoming a true extension of their software and data development capabilities. Through the readily set up, comprehensive, and self-governing teams, we let our Clients focus on...

  • Big Data Engineer Leader

    7 dni temu

    Warszawa, Mazovia, Polska Tietoevry Pełny etat

    We are seeking a highly skilled Big Data Engineer Leader to join our team. In this role, you will lead the development and maintenance of ETL/ELT pipelines using Python and SQL, as well as working with Hadoop, Spark, and Big Data technologies for large-scale data processing.The ideal candidate will have 4+ years' experience with database technologies,...

  • Big Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Atos Pełny etat

    We are currently seeking a skilled Software/Data Engineer to join our project for a German client in the energy sector.About the ProjectWe are working on cutting-edge data solutions using advanced technologies like Kubernetes, DataMesh, and ETL processes.The successful candidate will be responsible for designing and implementing robust data architectures and...

  • Big Data Engineering Specialist

    5 godzin temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Social network you want to login/join with:Staff Site Reliability Engineer (BIG DATA), WarsawClient:VISALocation:Warsaw, PolandJob Category:OtherEU work permit required:YesJob Reference:a904bd144234Job Views:3Posted:26.03.2025Expiry Date:10.05.2025

  • Big Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Big Data Engineer (Long term US Business Travel)Grid Dynamics, a global software services company driving enterprise-level digital transformation solutions for Fortune 1000 corporations, is looking for an experienced Big Data Engineer.Essential functionsResponsibilities:Build data pipelines to enable training of LLMs.Work with technical and non-technical...

  • Junior Big Data Application Engineer

    8 godzin temu

    Warszawa, Mazovia, Polska DXC Technology Inc. Pełny etat

    Big Data Specialist / Specjalista ds. Big DataBig Data Specialist / Specjalista ds. Big DataApply locations POL - ANY CITY time type Full time posted on Posted 3 Days Ago job requisition id 51532389Job Description:DXC Technology (NYSE: DXC) is the world's leading independent, end-to-end IT services company, helping clients harness the power of innovation to...

  • Big Data Engineer – M/F/D

    7 dni temu

    Warszawa, Mazovia, Polska SGS Société Générale de Surveillance SA Pełny etat

    ResponsibilitiesJoin our data-centric team at SG Group's Corporate and Investment Banking (CIB) division, working at the heart of the information system. We are responsible for building the new data platform that supports various business processes and interacts with multiple stakeholders. Our team is dedicated to implementing data solutions using the latest...

  • Data Engineer

    1 dzień temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.

  • Big Data Professional

    5 dni temu

    Warszawa, Mazovia, Polska Atos SE Pełny etat

    Role OverviewWe are seeking an experienced Software/Data Engineer to join our team for a significant project with a prominent German client in the energy sector. The ideal candidate will have a strong background in data engineering and cloud solutions, with hands-on experience in big data architectures and Kubernetes.Your Key AccountabilitiesDevelop and...

  • Data Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Quontex Ltd Pełny etat

    Our partner is a leading programmatic media company, specializing in ingesting large volumes of data, modeling insights, and offering a range of products and services across Media, Analytics, and Technology. Among their clients are well-known brands such as Walmart, Barclaycard, and Ford.The company has expanded to over 700 employees, with 15 global offices...

  • Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Quontex Ltd Pełny etat

    Our partner is a leading programmatic media company, specializing in ingesting large volumes of data, modeling insights, and offering a range of products and services across Media, Analytics, and Technology. Among their clients are well-known brands such as Walmart, Barclaycard, and Ford. The company has expanded to over 700 employees, with 15 global offices...

  • Big Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

    **Job Description Overview:**Axiom Software Solutions Limited is seeking a talented Big Data Engineer - Scala to join our team. As a Backend Spark developer, your mission will be to develop, test, and deploy technical and functional specifications from the Solution Designers/Business Architects/Business Analysts, ensuring correct operability and compliance...

  • Big Data Engineer

    2 godzin temu

    Warszawa, Mazovia, Polska Team Up Pełny etat

    For our client, a leading innovator in the technology and electronics industry, we are seeking Big Data Engineers. This project aims to connect brands with TV audiences by building a cutting-edge advertising platform using machine learning algorithms to enhance targeting, personalization, and optimization. Work alongside data scientists, product managers,...

  • Big Data Solutions Expert

    1 dzień temu

    Warszawa, Mazovia, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Job DescriptionWe are Square One Resources, a trusted partner company specializing in IT recruitment for 30 years. We understand the needs of IT experts and offer exciting opportunities for those seeking new challenges and skill enhancements.This role is designed for an experienced Data Engineer with expertise in Big Data or Machine Learning. The ideal...

  • Hadoop Big Data Administrator/Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Capco Poland Pełny etat

    *We are looking for Poland based candidate.  Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a...

  • Big Data Solution Developer

    7 dni temu

    Warszawa, Mazovia, Polska SGS Société Générale de Surveillance SA Pełny etat

    About Our TeamWe are part of the SGS Société Générale de Surveillance SA Corporate and Investment Banking (CIB) division, working at the heart of the information system. Our data-centric team is dedicated to implementing data solutions using the latest big data technologies to support structured finance activities within the GLBA business line.Your...

  • Data Engineer for Big Data Solutions

    2 dni temu

    Warszawa, Mazovia, Polska B2Bnetwork Pełny etat

    B2Bnetwork seeks a highly skilled ITSM Data Engineer (DevOps) to contribute to designing, building, and maintaining stable, scalable, and reliable BMC Helix data replication solutions.The project involves processing large data sets, optimizing data architecture, and implementing modern ETL solutions. We collaborate in a hybrid model, with at least one day...

  • Big Data Technology Lead

    6 dni temu

    Warszawa, Mazovia, Polska Rutkowski Pełny etat

    Rutkowski is seeking a highly skilled Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the infrastructure required to analyze large data sets. Our ideal candidate has strong experience with big data technologies, such as Spark, Hadoop, and NoSQL databases.Key Responsibilities:Closely...

  • Big Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    About ACAISOFT POLAND Sp. z o.o.: We are a cutting-edge software house dedicated to delivering innovative solutions that meet the evolving needs of our clients.We are currently looking for a seasoned Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring seamless data...

  • Big Data Processing Expert

    17 godzin temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Job DescriptionGrid Dynamics International, Inc. is a leading provider of technology consulting and platform engineering services. We seek a highly skilled Big Data Engineer to join our team and contribute to building critical risk and fraud detection applications.Essential FunctionsDesign, develop, and implement high-availability, low-latency, and strongly...

Big Data Engineer, Warsaw

4 tygodni temu

Warszawa, Mazovia, Polska TN Poland Pełny etat

Job Summary:

Our company is seeking experienced developers to contribute to the development and expansion of our data processing platform. The ideal candidate will have expertise in building and maintaining distributed systems that process large amounts of data in real-time.

Key Responsibilities:

  • Design, develop, and maintain scalable and efficient distributed systems for real-time data processing
  • Optimize software performance and resource utilization
  • Ensure system reliability, scalability, and fault tolerance
  • Develop performance and correctness tests for new system components
  • Assess new technologies for their applicability in production environments
  • Develop tools for monitoring and analyzing production system operation
  • Continuously improve existing tools and processes

Technologies Used:

  • Java and Python programming languages
  • Hadoop and Kafka frameworks
  • Docker, Jenkins, and Graphite for containerization and deployment
  • Google Big Query and Elastic search engines

Recent Challenges:

  • Migrating from Storm to Kafka Streams in the data processing component
  • Creating a data stream merger using the Kafka Client API
  • Implementing a user profile synchronizer between data centers using Kafka Streams
  • Developing an aggregate calculator based on the Kafka Client API and Bloom filters
  • Transitioning from Flume and Solr to Logstash and Elastic
  • Establishing end-to-end monitoring for data correctness and delay
  • Replacing the data streaming component with BigQuery and HDFS

Requirements:

  • Proficiency in programming
  • Deep understanding of complex IT systems (hardware, software, and algorithmics)
  • Knowledge of concurrent programming and distributed systems methodologies
  • Ability to analyze and optimize production system performance
  • Readiness to work in a DevOps environment

Preferred Qualifications:

  • Experience with Big Data technologies such as Hadoop, Kafka, Storm, Spark, or Flink
  • Knowledge of application profiling methods and tools

We Offer:

  • A collaborative team environment with knowledge-sharing opportunities
  • Flexible work arrangements with remote work options
  • Access to the latest technologies and the opportunity to apply them in a large-scale project