Big Data Engineer for Real-Time Analytics
5 dni temu
Job Overview:
We are seeking a skilled Big Data Engineer to join our team at emagine Consulting in Warsaw. This is an exciting opportunity to work on implementing real-time analytics solutions using Scala and Spark.
About the Role:
The ideal candidate will have experience in building distributed and highly parallelized BigData processing pipelines that process massive amounts of structured and unstructured data in near real-time. They will also be responsible for leveraging Spark to enrich and transform corporate data, enabling searching, data visualization, and advanced analytics.
Key Responsibilities:
- Design and implement a scalable Big Data architecture using Hadoop stack components such as YARN, EMR, Sqoop, Hive, and Kafka.
- Develop efficient Spark applications to process and transform large datasets.
- Collaborate closely with DevOps, QA, and Product Management teams in a Continuous Delivery environment.
Requirements:
- Minimum 3 years of experience in Scala and Spark development.
- Familiarity with the Hadoop stack, including YARN, EMR, Sqoop, Hive, and Kafka.
- Strong understanding of big data processing concepts and techniques.
- Excellent communication skills and experience working in distributed global teams.
- Prior Financial Service experience is highly desirable.
What We Offer:
- A competitive salary of approximately PLN 80,000 - 100,000 per month, depending on experience.
- A dynamic and collaborative work environment.
-
Big Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska RTB House Pełny etatWe are looking for a highly skilled Data Engineer to join our team at RTB House. As a key member of our data processing platform, you will play a crucial role in building and expanding our real-time data processing capabilities.Your Responsibilities:Design and develop distributed systems for processing large amounts of data in real-time.Optimize the...
-
Data Architect for Big Data Solutions
3 dni temu
Warszawa, Mazovia, Polska b2bnetwork Pełny etatAbout the RoleWe are seeking a highly skilled Data Architect to join our team at b2bnetwork. As a key member of our organization, you will be responsible for designing and implementing data solutions that meet the needs of our clients.Key ResponsibilitiesDevelop and evolve the solution design for the Financial Crime Data Hub (FCDH), including detailing the...
-
Senior Web Engineer for Real-Time Data Analysis
2 tygodni temu
Warszawa, Mazovia, Polska Groupe SII Pełny etatWe are seeking an experienced Senior Web Engineer to join our project at Groupe SII in Warsaw. As a Frontend Developer with React, you will play a key role in developing a new strategic real-time liquidity platform using JavaScript tech stack.Your main responsibilities will include:Developing software that analyzes data and provides insights to...
-
Distributed Big Data Architect
3 dni temu
Warszawa, Mazovia, Polska emagine Consulting Pełny etatAbout UsAt emagine Consulting, we pride ourselves on being a leader in providing innovative solutions to complex business problems. Our team is comprised of experts who share a passion for technology and a commitment to excellence.CompensationThe estimated salary for this position is approximately 120-150 PLN/hour (B2B rate) based on industry standards and...
-
Technical Solutions Engineer Data Analytics Expert
2 tygodni temu
Warszawa, Mazovia, Polska Google Pełny etatAbout the RoleAt Google, we're constantly pushing the boundaries of innovation and excellence. As a Technical Solutions Engineer Data Analytics Expert, you'll play a critical role in helping our customers unlock the full potential of our data analytics solutions.We're looking for an exceptional individual who can develop in-depth expertise in Google Cloud's...
-
Senior Software Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Microsoft Pełny etatAbout the RoleMicrosoft is a company where passionate innovators come to collaborate, envision what can be, and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.The Azure Data engineering team is leading the transformation of analytics in the world of...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska VGW Pełny etatSenior Data Engineer - Game DevelopmentWe are seeking a highly skilled Senior Data Engineer to join our team in Poland. As a key member of our Growth team, you will be responsible for integrating new games into our existing systems, ensuring a seamless experience for our players.Tech We UseOur current analytics stack includes Snowflake, Databricks, AWS...
-
Warszawa, Mazovia, Polska Sportradar Pełny etatAbout SportradarSportradar is a global leader in providing sports data and content solutions to over 200 organizations worldwide. Our innovative products and services empower clients to create engaging experiences for their users.Job OverviewWe are seeking a highly skilled Senior Java Software Engineer to join our team of experts in developing real-time...
-
Big Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatBig Data Job DescriptionWe are seeking an experienced Big Data Developer to work on a data-driven initiative focused on enhancing group risk reporting and supporting various use cases through the development of new and optimization of existing data pipelines.Job ResponsibilitiesThe role involves re-modeling and aggregating data inputs into a common format,...
-
Big Data Engineer
4 tygodni temu
Warszawa, Mazovia, Polska ITDS Polska Sp. Z O.o. Pełny etatJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at ITDS Polska Sp. Z O.o. As a Senior Data Engineer, you will be responsible for designing, developing, and supporting data engineering solutions for our clients in the life sciences industry.About the Role: As a Senior Data Engineer, you will work collaboratively with our...
-
Big Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Jit Team Pełny etatJob DescriptionAs a Junior Big Data Engineer at Jit Team, you will be part of a dynamic team working on various projects, including providing first-level support and technical expertise to the DROC team.Key Responsibilities:Executing ETL processes and refreshing UIs for data validationAssisting with Spark/Hive queries for dataset analysisClassifying and...
-
Big Data Architect
3 tygodni temu
Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etatProject OverviewSunscrapers sp. z o.o. is a leading force in software development, expanding its presence in data-centric environments.Job DescriptionAs a Senior Data Engineer, you will report to the Head of Data & Analytics and help build the entire data stack and infrastructure that support our operations.Key ResponsibilitiesDesign, build, and maintain...
-
Technical Lead for Real-Time Systems
3 dni temu
Warszawa, Mazovia, Polska Goldman Sachs Pełny etatAbout the Role">We are seeking an experienced Technical Lead to oversee the development of our real-time systems, working closely with cross-functional teams to design and implement high-quality solutions.">Job Summary">The successful candidate will have a strong track record in designing and implementing real-time distributed processing systems and event...
-
Data Engineer
4 tygodni temu
Warszawa, Mazovia, Polska Jit Team Pełny etatJob Title: Data Engineer - Junior Big Data SpecialistJob Summary:We are seeking a highly motivated and detail-oriented Data Engineer to join our team as a Junior Big Data Specialist. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement ETL...
-
Big Data Architect
1 dzień temu
Warszawa, Mazovia, Polska RTB House Pełny etatJob Description:We are seeking an experienced developer to build and expand our data processing platform. As a key member of our team, you will play a crucial role in ensuring the efficiency, reliability, and scalability of our solutions.Responsibilities:Develop and maintain distributed systems for real-time data processingOptimize software for efficient...
-
Data Analytics Expert
1 miesiąc temu
Warszawa, Mazovia, Polska Randstad Polska Pełny etatJob Title: Principal Data AnalystAbout the Role:We are seeking an experienced Principal Data Analyst to join our analytical team at a leading company in the pharmaceutical industry. As a key member of our team, you will be responsible for working with a global customer base to define, implement, and deliver robust data, analytics, and benchmarking to support...
-
Senior Big Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska Sanoma Pełny etatEstablishing the Future of EducationSanoma Learning, a leading European learning company, is seeking a highly skilled Kafka Engineer to join their Technology organization. As a key member of the team, you will play a crucial role in shaping the future of education in Europe.Project OverviewThe primary objective of this role is to establish the key technical...
-
Kafka Engineer for Big Data Platform Development
4 tygodni temu
Warszawa, Mazovia, Polska Sanoma Pełny etatJob Description:Sanoma Learning is a leading European learning company serving over 20 million students in 11 countries. We offer printed and digital learning materials as well as digital learning and teaching platforms for primary, secondary, and vocational education. As a Kafka Engineer, you will be responsible for building, improving, and scaling our...
-
Big Data Engineering Specialist
2 tygodni temu
Warszawa, Mazovia, Polska Jit Team Pełny etatAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Warsaw. As a Senior Big Data Engineer, you will be responsible for providing first-level support and technical expertise to our DROC team.Key Responsibilities:
-
Big Data Architectural Leader
5 dni temu
Warszawa, Mazovia, Polska Addepto Pełny etatCompany Overview">Addepto is a pioneering consulting and technology company specializing in AI and Big Data, empowering clients to deliver innovative data projects. We partner with leading global enterprises and forward-thinking startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our expertise in AI and Big Data has earned us recognition by...