Big Data Cluster Engineer
18 godzin temu
We are looking for a highly skilled and experienced Hadoop Administrator to oversee the installation, configuration, and maintenance of our large-scale Hadoop ecosystem components.
Key Responsibilities:- Hadoop Cluster Management
- Implement and maintain Apache Kafka for real-time data streaming and integration within the Hadoop ecosystem.
- Optimize and fine-tune Hadoop and Kafka environments to ensure smooth data processing pipelines.
- Scala Application Development
- Troubleshoot performance issues and resolve system failures promptly.
- Collaborate with data engineers, data scientists, and other teams to ensure data workflows run smoothly across the Hadoop infrastructure.
- Data Security and Compliance
- Ensure data security, access controls, and compliance requirements are met within the Hadoop and Kafka ecosystems.
- Automation and Support
- Develop and maintain automation scripts for cluster deployment, monitoring, and management.
- Provide support and guidance on best practices for data ingestion, storage, and processing in Hadoop.
Required Skills & Qualifications:
- Proven experience as a Hadoop Administrator in a large-scale production environment.
- Strong expertise with Hadoop ecosystem tools such as HDFS, YARN, MapReduce, Hive, Pig, and Spark.
- Experience with Apache Kafka for real-time data streaming and integration.
- Proficiency in Scala for developing and optimizing data processing applications.
- Knowledge of Big Data tools such as Hive, HBase, or Flume is a plus.
- Strong understanding of Linux-based operating systems, networking, and system administration.
- Experience with Hadoop security including Kerberos and access control mechanisms.
- Familiarity with data ingestion frameworks and ETL processes.
- Solid troubleshooting and problem-solving skills in distributed systems.
- Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
- Excellent communication and collaboration skills.
Preferred Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
- Certifications in Hadoop or other Big Data technologies.
- Experience with cloud platforms like AWS, Azure, or Google Cloud.
-
Senior Big Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatJob Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...
-
Big Data Reliability Engineer
1 miesiąc temu
Warszawa, Polska DCV Technologies Pełny etatDCV Technologies is seeking a highly skilled Big Data Reliability Engineer to join our team in Poland.We offer a competitive daily rate of up to 1,250 PLN/day + VAT for this role.About the RoleAs a Big Data Reliability Engineer, you will be responsible for ensuring the reliability and performance of our Big Data platforms, including Hadoop, Spark, and HBASE....
-
Big Data Solutions Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatWe are seeking a highly skilled Hadoop Administrator to join our client team on a B2B contract basis.This is an exciting opportunity to work with a multinational client headquarted in the US and a leader in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.Job Opportunity: Hadoop...
-
Big Data Systems Engineer
2 tygodni temu
aleje Jerozolimskie , Warszawa, Polska Kevin Edward Pełny etatAbout Kevin EdwardKevin Edward is a forward-thinking organization that specializes in innovative data management solutions. We're seeking an experienced Big Data Systems Engineer to join our team and help us drive business growth through data-driven insights.
-
Big Data Engineer
1 tydzień temu
Warszawa, Polska PZU S.A. Pełny etatBig Data Engineer31_000019282Obowiązki Projektowanie i implementacja nowoczesnych rozwiązań w oparciu o technologie Big DataDefiniowanie i rozwijanie dobrych praktyk i standardów programistycznych w PZUZapewnianie właściwej jakości wytwarzanego oprogramowaniaWspółpraca z członkami zespołu zwinnego oraz projektowego w celu...
-
Big Data Solutions Architect
1 dzień temu
Warszawa, Polska Experis Manpower Group Pełny etatJob SummaryWe are seeking an experienced Senior Big Data Engineer to design, develop, and maintain scalable data pipelines and systems. The ideal candidate will have a strong background in big data technologies and a passion for building high-quality data solutions.
-
Big Data Engineer with Cloud Expertise
3 tygodni temu
Warszawa, Mazovia, Polska Datumo Pełny etatAbout DatumoDatumo is a leading Big Data and Cloud consulting services provider, serving clients globally, particularly in Western Europe, Poland, and the USA. Our core industries include e-commerce, telecommunications, and life science.Our team boasts exceptional individuals committed to delivering high-demanding projects. Team members tend to stay for more...
-
Senior Big Data Engineer
3 tygodni temu
Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etatJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...
-
Senior Big Data Architect
3 tygodni temu
Warszawa, Mazovia, Polska Jit Team Pełny etat**Job Description:**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will work with the Hadoop ecosystem to develop and manage big data solutions.**Key Responsibilities:**Develop and manage big data solutions using Hadoop ecosystemSet up CI/CD pipelines and work with Docker and Kubernetes platformsManage relational...
-
Big Data Engineer with Apache Spark Expertise
1 miesiąc temu
Warszawa, Polska Link Group Pełny etatJob Title: Big Data Engineer with Apache Spark Expertise**Company Overview**We are a leading global business solutions provider, Link Group. Our company is dedicated to delivering innovative solutions that transform the way businesses operate.**Salary:** We offer a highly competitive salary of $120,000 - $180,000 per annum, depending on experience and...
-
Big Data Engineer
2 tygodni temu
Warszawa, Polska DCG Pełny etatJob Description:We are seeking a highly skilled Big Data Engineer to join our team as an Architecture Specialist.About the Role:The successful candidate will be responsible for designing and implementing scalable, reliable, and secure data platform architectures using Azure services and Azure Databricks.You will work closely with Product Owners, Data...
-
Big Data Engineer
2 miesięcy temu
Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are looking for a skilled Big Data Engineer to join our team and contribute to the Cassandra Ingestion Service project. You’ll be working with a highly selective client who values quality and precision in every aspect of development. This role requires expertise in handling large-scale data using technologies such as Cassandra,...
-
Big Data Engineer for Hybrid Environment
3 tygodni temu
Warszawa, Polska HAYS Poland Pełny etatHays Poland Job Offer">At Hays Poland, we specialize in connecting talented IT and Engineering professionals with the most exciting technological projects on the market.We're a leading B2B cooperation that believes in creating mutually beneficial partnerships.In our current job offer, we're seeking a skilled Big Data Engineer for Hybrid Environment to join...
-
Big Data Software Engineer
18 godzin temu
Warszawa, Mazovia, Polska Datumo Pełny etatCompany Overview">Datumo is a renowned provider of Big Data and Cloud consulting services to clients worldwide, with primary operations in Western Europe, Poland, and the USA. We cater to core industries including e-commerce, telecommunications, and life science. Our team consists of exceptional individuals driven by a commitment to excellence, enabling us...
-
Data Engineer with Hadoop Expertise Wanted in Gdańsk
3 tygodni temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatWe are B2B S.A, a company looking for a skilled Data Engineer to join our team.The ideal candidate will have experience working with Hadoop and be able to take on complex projects independently.A strong background in Big Data technologies, including Spark and Scala, is required.In addition, experience with Docker and Kubernetes platforms, as well as...
-
Cloud Data Engineer
2 dni temu
Warszawa, Polska Procter & Gamble Pełny etatAt Procter & Gamble, we're committed to innovation and leadership. As a Cloud Data Engineer, you'll play a critical role in designing, developing, and implementing data pipelines that acquire, cleanse, transform, and publish data to Databricks backend.Key Responsibilities:Designing and developing large, complex data sets that meet functional and...
-
Big Data Developer
2 miesięcy temu
Warszawa, Polska B2B.net S.A Pełny etatWe are looking for an experienced Big Data Developer for a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Big Data DeveloperYour responsibilities The role involves re-modeling and aggregating data inputs...
-
Big Data Ecosystem Manager
3 tygodni temu
Warszawa, Polska Kevin Edward Pełny etatAbout Kevin EdwardWe are a technology-driven organization seeking an experienced Big Data Ecosystem Manager to lead our big data infrastructure. If you have expertise in Hadoop, Spark, and Kafka, we want to hear from you.Estimated Salary: $120,000 - $180,000 per yearJob Description:Hadoop, Spark, and Kafka AdministrationManage and support the deployment,...
-
Big Data Ecosystem Architect
3 tygodni temu
centrum, Warszawa, Polska Kevin Edward Pełny etatJob DescriptionWe are seeking a seasoned Big Data Ecosystem Architect to spearhead the design and deployment of large-scale big data environments at Kevin Edward.The ideal candidate will have a deep understanding of distributed computing principles, data storage systems, and expertise in Hadoop, Spark, and Kafka administration.Key Responsibilities:Hadoop,...
-
Big Data Engineer in Samsung Ads Project
3 dni temu
Warszawa, mazowieckie, Polska Samsung R&D Institute Poland Pełny etatAbout our TeamWe seek a highly skilled and motivated Big Data Engineer to join our growing Samsung Ads team. As Big Data Engineer, you will contribute to development and buildout of components of Samsung’s DSP platform.You will be closely working with local team in Warsaw, having also many opportunities of collaboration with Samsung’s remote teams across...