Big Data Reliability Engineer
1 miesiąc temu
Big Data Reliability Engineer
(Remote in Poland, occasional office visits in Warsaw)
We are seeking an experienced Hadoop Admin/Site Reliability Engineer to join our team driving innovation in Big Data and ensuring platform reliability for a global leader in the digital payments space.
About Our Client
Our client is a world-leading digital payments network that connects people and removes barriers worldwide. As a member of this innovative team, you will have the opportunity to work with cutting-edge technologies such as Hadoop, Spark, and HBASE.
Key Responsibilities
- Perform SRE duties for Big Data platforms, focusing on troubleshooting and resolving issues using open-source technologies.
- Monitor platforms and follow established runbooks/SOPs to resolve platform and application issues.
- Manage cluster maintenance, implementing changes according to installation and validation plans.
- Demonstrate strong problem-solving skills to identify and resolve complex issues, providing preventive recommendations to improve system reliability.
- Conduct root cause analysis of significant production incidents, document lessons learned, and implement proactive measures to enhance system resilience.
- Automate routine tasks with scripts and automation tools, reducing manual workload and minimizing errors.
Required Skills and Qualifications
We require:
At least 6+ years of experience as a Hadoop Site Reliability Engineer or similar role.
In-depth knowledge of Hadoop platforms and core components such as HDFS, Yarn, MapReduce, and Hive.
Expertise in troubleshooting Hadoop platform services and applications, identifying and resolving root causes.
Experience writing Ansible playbooks and automating tasks using Shell scripting and Python.
Solid understanding of Unix/Linux system internals, networking, and distributed systems.
Estimated Salary: Up to 1,250 PLN/day + VAT
-
Big Data Reliability Engineer
4 tygodni temu
Warszawa, Polska DCV Technologies Pełny etatDCV Technologies is seeking a highly skilled Big Data Reliability Engineer to join our team in Poland.We offer a competitive daily rate of up to 1,250 PLN/day + VAT for this role.About the RoleAs a Big Data Reliability Engineer, you will be responsible for ensuring the reliability and performance of our Big Data platforms, including Hadoop, Spark, and HBASE....
-
Big Data Engineer for Hybrid Environment
2 tygodni temu
Warszawa, Polska HAYS Poland Pełny etatHays Poland Job Offer">At Hays Poland, we specialize in connecting talented IT and Engineering professionals with the most exciting technological projects on the market.We're a leading B2B cooperation that believes in creating mutually beneficial partnerships.In our current job offer, we're seeking a skilled Big Data Engineer for Hybrid Environment to join...
-
Senior Big Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatJob Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...
-
Big Data Engineer
2 miesięcy temu
Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are looking for a skilled Big Data Engineer to join our team and contribute to the Cassandra Ingestion Service project. You’ll be working with a highly selective client who values quality and precision in every aspect of development. This role requires expertise in handling large-scale data using technologies such as Cassandra,...
-
Big Data Systems Engineer
5 dni temu
aleje Jerozolimskie , Warszawa, Polska Kevin Edward Pełny etatAbout Kevin EdwardKevin Edward is a forward-thinking organization that specializes in innovative data management solutions. We're seeking an experienced Big Data Systems Engineer to join our team and help us drive business growth through data-driven insights.
-
Big Data Engineer
1 dzień temu
Warszawa, Polska PZU S.A. Pełny etatBig Data Engineer31_000019282Obowiązki Projektowanie i implementacja nowoczesnych rozwiązań w oparciu o technologie Big DataDefiniowanie i rozwijanie dobrych praktyk i standardów programistycznych w PZUZapewnianie właściwej jakości wytwarzanego oprogramowaniaWspółpraca z członkami zespołu zwinnego oraz projektowego w celu...
-
Senior Big Data Engineer
2 tygodni temu
Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etatJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...
-
Big Data Solutions Engineer
4 tygodni temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatWe are seeking a highly skilled Hadoop Administrator to join our client team on a B2B contract basis.This is an exciting opportunity to work with a multinational client headquarted in the US and a leader in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.Job Opportunity: Hadoop...
-
Site Reliability Engineer
2 miesięcy temu
Warszawa, Polska HAYS Pełny etatSite Reliability Engineer - HadoopWarszawaNR REF.: 1189860Hays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market. Join the group of 500 satisfied Contractors working for Hays’ clients!For our Client we are currently looking for Candidates with experience between 2-7...
-
Senior Big Data Architect
2 tygodni temu
Warszawa, Mazovia, Polska Jit Team Pełny etat**Job Description:**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will work with the Hadoop ecosystem to develop and manage big data solutions.**Key Responsibilities:**Develop and manage big data solutions using Hadoop ecosystemSet up CI/CD pipelines and work with Docker and Kubernetes platformsManage relational...
-
Big Data Engineer with Apache Spark Expertise
4 tygodni temu
Warszawa, Polska Link Group Pełny etatJob Title: Big Data Engineer with Apache Spark Expertise**Company Overview**We are a leading global business solutions provider, Link Group. Our company is dedicated to delivering innovative solutions that transform the way businesses operate.**Salary:** We offer a highly competitive salary of $120,000 - $180,000 per annum, depending on experience and...
-
Big Data Engineer
5 dni temu
Warszawa, Polska DCG Pełny etatJob Description:We are seeking a highly skilled Big Data Engineer to join our team as an Architecture Specialist.About the Role:The successful candidate will be responsible for designing and implementing scalable, reliable, and secure data platform architectures using Azure services and Azure Databricks.You will work closely with Product Owners, Data...
-
Site Reliability Engineer
2 dni temu
Warszawa, mazowieckie, Polska Cosmose AI Pełny etatSite Reliability Engineer, Poland, Warsaw (hybrid)Unicorn Foundations: Cosmose AI, a fast-growing software company that seamlessly connects the offline and online worlds, has achieved remarkable milestones. With a valuation exceeding $500 million and a successful funding round in April 2023, we have become a pioneering technology player. Our innovative...
-
Big Data Engineer
1 miesiąc temu
Daimlera, Warszawa, Polska DCG Pełny etatAbout UsAt DCG, we specialize in providing experienced professionals to businesses across various sectors. Our unique approach enables us to understand the specific needs of our clients and provide tailored support.About the RoleWe are currently looking for a talented Big Data Engineer to join our team. As a Big Data Engineer - Risk Reporting and Analytics,...
-
Big Data Engineering Lead
1 miesiąc temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatSenior Data EngineerYour Key Responsibilities:Data Ingestion and Transformation: Collaborate with cross-functional teams to design, develop, and maintain large-scale data ingestion and transformation processes using Spark and Python.Distributed Data Processing: Build high-performance, parallelized big data processing pipelines to process massive amounts of...
-
Big Data Engineer with Cloud Expertise
2 tygodni temu
Warszawa, Mazovia, Polska Datumo Pełny etatAbout DatumoDatumo is a leading Big Data and Cloud consulting services provider, serving clients globally, particularly in Western Europe, Poland, and the USA. Our core industries include e-commerce, telecommunications, and life science.Our team boasts exceptional individuals committed to delivering high-demanding projects. Team members tend to stay for more...
-
Big Data Solutions Architect
2 miesięcy temu
Warszawa, mazowieckie, Polska BlueSoft Pełny etatJob Summary:Data Solutions Architects play a key role in designing and delivering advanced data architectures and analytics solutions. Focused on both cloud and on-premise environments, this role ensures robust data management and security. You will lead architectural sessions, create proof-of-concepts, and collaborate with clients to build scalable, secure...
-
Big Data Developer
2 miesięcy temu
Warszawa, Polska B2B.net S.A Pełny etatWe are looking for an experienced Big Data Developer for a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Big Data DeveloperYour responsibilities The role involves re-modeling and aggregating data inputs...
-
Big Data Ecosystem Manager
2 tygodni temu
Warszawa, Polska Kevin Edward Pełny etatAbout Kevin EdwardWe are a technology-driven organization seeking an experienced Big Data Ecosystem Manager to lead our big data infrastructure. If you have expertise in Hadoop, Spark, and Kafka, we want to hear from you.Estimated Salary: $120,000 - $180,000 per yearJob Description:Hadoop, Spark, and Kafka AdministrationManage and support the deployment,...
-
Big Data Ecosystem Architect
2 tygodni temu
centrum, Warszawa, Polska Kevin Edward Pełny etatJob DescriptionWe are seeking a seasoned Big Data Ecosystem Architect to spearhead the design and deployment of large-scale big data environments at Kevin Edward.The ideal candidate will have a deep understanding of distributed computing principles, data storage systems, and expertise in Hadoop, Spark, and Kafka administration.Key Responsibilities:Hadoop,...