Big Data Reliability Engineer

2 tygodni temu


Warszawa, Polska DCV Technologies Pełny etat

DCV Technologies is seeking a highly skilled Big Data Reliability Engineer to join our team in Poland.

We offer a competitive daily rate of up to 1,250 PLN/day + VAT for this role.

About the Role

As a Big Data Reliability Engineer, you will be responsible for ensuring the reliability and performance of our Big Data platforms, including Hadoop, Spark, and HBASE. You will work closely with our engineering team to identify and resolve issues, implement changes, and automate routine tasks using scripts and automation tools.

Your Key Responsibilities Will Include:

  • Performing SRE duties for Big Data platforms, working with open-source technologies such as Hadoop, Spark, and HBASE.
  • Monitoring platforms and following runbooks/SOPs to resolve platform and application issues.
  • Managing cluster maintenance, implementing changes according to installation and validation plans.
  • Demonstrating strong troubleshooting and debugging skills to identify and resolve issues while providing preventive recommendations.
  • Conducting root cause analysis of significant production incidents, documenting lessons learned, and implementing proactive measures to improve system reliability.
  • Automating routine tasks with scripts and automation tools, reducing manual workload and minimizing errors.

You Will Be Expected to Have:

  • A minimum of 6+ years of experience as a Hadoop Site Reliability Engineer or similar role.
  • In-depth knowledge of Hadoop platforms and core components such as HDFS, Yarn, MapReduce, and Hive.
  • Expertise in troubleshooting Hadoop platform services and applications, identifying and resolving root causes.
  • Experience writing Ansible playbooks and automating tasks using Shell scripting and Python.
  • Solid understanding of Unix/Linux system internals, networking, and distributed systems.

About Us

At DCV Technologies, we are passionate about Big Data and reliability engineering. We believe in innovation and continuously strive to improve our systems and processes. If you share our passion and have the required skills and qualifications, we would love to hear from you.



  • City, Warszawa, Polska DCV Technologies Pełny etat

    Big Data Reliability Engineer (Remote in Poland, occasional office visits in Warsaw)We are seeking an experienced Hadoop Admin/Site Reliability Engineer to join our team driving innovation in Big Data and ensuring platform reliability for a global leader in the digital payments space.About Our ClientOur client is a world-leading digital payments network that...


  • Warszawa, Polska HAYS Poland Pełny etat

    Hays Poland Job Offer">At Hays Poland, we specialize in connecting talented IT and Engineering professionals with the most exciting technological projects on the market.We're a leading B2B cooperation that believes in creating mutually beneficial partnerships.In our current job offer, we're seeking a skilled Big Data Engineer for Hybrid Environment to join...


  • Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...


  • Warszawa, Mazovia, Polska EndySoft Pełny etat

    We are seeking a highly skilled Big Data Engineer to join our data engineering team at EndySoft. This role offers an opportunity to work on complex, large-scale data projects and contribute to shaping the future of data-driven decision-making.Job SummaryThis is a challenging position that requires extensive experience in building and managing large-scale...

  • Big Data Engineer

    2 miesięcy temu


    Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etat

    We are looking for a skilled Big Data Engineer to join our team and contribute to the Cassandra Ingestion Service project. You’ll be working with a highly selective client who values quality and precision in every aspect of development. This role requires expertise in handling large-scale data using technologies such as Cassandra,...

  • Big Data Engineer

    2 miesięcy temu


    Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Big Data Job DescriptionWe are seeking an experienced Big Data Developer to work on a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Job ResponsibilitiesThe role involves re-modeling and aggregating data inputs into a common format,...


  • Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...

  • Site Reliability Engineer

    2 miesięcy temu


    Warszawa, Polska HAYS Pełny etat

    Site Reliability Engineer - HadoopWarszawaNR REF.: 1189860Hays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market. Join the group of 500 satisfied Contractors working for Hays’ clients!For our Client we are currently looking for Candidates with experience between 2-7...


  • Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    We are seeking a highly skilled Hadoop Administrator to join our client team on a B2B contract basis.This is an exciting opportunity to work with a multinational client headquarted in the US and a leader in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.Job Opportunity: Hadoop...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    **Job Description:**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will work with the Hadoop ecosystem to develop and manage big data solutions.**Key Responsibilities:**Develop and manage big data solutions using Hadoop ecosystemSet up CI/CD pipelines and work with Docker and Kubernetes platformsManage relational...


  • Warszawa, Polska Link Group Pełny etat

    Job Title: Big Data Engineer with Apache Spark Expertise**Company Overview**We are a leading global business solutions provider, Link Group. Our company is dedicated to delivering innovative solutions that transform the way businesses operate.**Salary:** We offer a highly competitive salary of $120,000 - $180,000 per annum, depending on experience and...

  • Big Data Engineer

    4 tygodni temu


    Daimlera, Warszawa, Polska DCG Pełny etat

    About UsAt DCG, we specialize in providing experienced professionals to businesses across various sectors. Our unique approach enables us to understand the specific needs of our clients and provide tailored support.About the RoleWe are currently looking for a talented Big Data Engineer to join our team. As a Big Data Engineer - Risk Reporting and Analytics,...

  • Big Data Engineering Lead

    4 tygodni temu


    Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Senior Data EngineerYour Key Responsibilities:Data Ingestion and Transformation: Collaborate with cross-functional teams to design, develop, and maintain large-scale data ingestion and transformation processes using Spark and Python.Distributed Data Processing: Build high-performance, parallelized big data processing pipelines to process massive amounts of...

  • Big Data Developer

    2 miesięcy temu


    Warszawa, Polska B2B.net S.A Pełny etat

    We are looking for an experienced Big Data Developer for a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Big Data DeveloperYour responsibilities The role involves re-modeling and aggregating data inputs...

  • Big Data Solutions Architect

    2 miesięcy temu


    Warszawa, mazowieckie, Polska BlueSoft Pełny etat

    Job Summary:Data Solutions Architects play a key role in designing and delivering advanced data architectures and analytics solutions. Focused on both cloud and on-premise environments, this role ensures robust data management and security. You will lead architectural sessions, create proof-of-concepts, and collaborate with clients to build scalable, secure...


  • Warszawa, Mazovia, Polska Datumo Pełny etat

    About DatumoDatumo is a leading Big Data and Cloud consulting services provider, serving clients globally, particularly in Western Europe, Poland, and the USA. Our core industries include e-commerce, telecommunications, and life science.Our team boasts exceptional individuals committed to delivering high-demanding projects. Team members tend to stay for more...

  • Senior Big Data Engineer

    2 miesięcy temu


    Warszawa, mazowieckie, Polska mBank Pełny etat

    Jesteśmy 12 osobowym zespołem pracującym w SCRUMie w obszarze Big Data. Realizujemy projekty biznesowe jak i te R&D. Moglibyśmy o nich opowiadać godzinami, ale krótko nakreślając. Jesteśmy odpowiedzialni m.in za implementację rozwiązań z zakresu przetwarzania streamingowego (znacznie skróciliśmy czas ładowania danych pod raporting w banku)....


  • Warszawa, Polska Kevin Edward Pełny etat

    About Kevin EdwardWe are a technology-driven organization seeking an experienced Big Data Ecosystem Manager to lead our big data infrastructure. If you have expertise in Hadoop, Spark, and Kafka, we want to hear from you.Estimated Salary: $120,000 - $180,000 per yearJob Description:Hadoop, Spark, and Kafka AdministrationManage and support the deployment,...

  • Cloud Data Engineer

    4 tygodni temu


    Marszałkowska /, Warszawa, Polska HAYS Poland Pełny etat

    Hays IT Contracting is a business-to-business cooperation that connects top IT and Engineering specialists with the most exciting projects.With over 500 contractors satisfied with their work, we are a reliable partner for both candidates and clients.We are currently looking for skilled professionals to fill a crucial role for our client:Hadoop Site...


  • centrum, Warszawa, Polska Kevin Edward Pełny etat

    Job DescriptionWe are seeking a seasoned Big Data Ecosystem Architect to spearhead the design and deployment of large-scale big data environments at Kevin Edward.The ideal candidate will have a deep understanding of distributed computing principles, data storage systems, and expertise in Hadoop, Spark, and Kafka administration.Key Responsibilities:Hadoop,...