Senior Big Data Engineer
7 miesięcy temu
Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in digital payments technology, it's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive.
We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.
Essential functions
Design and Develop Big Data Solutions : Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements. Data Ingestion and Processing : Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats. Optimize Data Pipelines : Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency. Cluster Management and Optimization : Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications. Real-Time Data Processing : Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making. Data Quality and Governance : Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems. Performance Tuning and Monitoring : Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.
Qualifications
Strong Programming Skills : Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala. Expertise in Big Data Technologies : Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase. Advanced Spark Knowledge : In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics. Data Modeling and ETL : Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies. Cluster Management Tools : Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling. SQL and NoSQL Databases : Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
We offer
Opportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Benefits package - medical insurance, sports Corporate social events Professional development opportunities Well-equipped office
About us
Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud migration, and application modernisation. Grid Dynamics achieves high speed-to-market, quality, and efficiency by using technology accelerators, an agile delivery culture, and its pool of global engineering talent. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, UK, Netherlands, Mexico, and Central and Eastern Europe. To learn more about Grid Dynamics, please visit www.griddynamics.com. Follow us on Facebook, Twitter, and LinkedIn.
-
Senior Data Engineer
6 miesięcy temu
Warsaw, Polska VGW Pełny etatSenior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games. We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...
-
Senior Big Data Engineer
1 miesiąc temu
Warsaw, Polska mBank Pełny etatJesteśmy 12 osobowym zespołem pracującym w SCRUMie w obszarze Big Data. Realizujemy projekty biznesowe jak i te R&D. Moglibyśmy o nich opowiadać godzinami, ale krótko nakreślając. Jesteśmy odpowiedzialni m.in za implementację rozwiązań z zakresu przetwarzania streamingowego (znacznie skróciliśmy czas ładowania danych pod raporting w banku)....
-
Big Data Solutions Architect
1 miesiąc temu
Warsaw, Polska BlueSoft Pełny etatJob Summary: Data Solutions Architects play a key role in designing and delivering advanced data architectures and analytics solutions. Focused on both cloud and on-premise environments, this role ensures robust data management and security. You will lead architectural sessions, create proof-of-concepts, and collaborate with clients to build scalable,...
-
Senior Azure Data Engineer
7 miesięcy temu
Warsaw, Polska C&F S.A. Pełny etatC&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry. Senior Azure Data...
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska BEC Poland Pełny etatSenior Data Engineer For this role, we are looking for someone to join Nykredit – one of the banks BEC Poland works closely with. Nykredit is both a bank and a mortgage provider owned by an association of customers. Being customer-owned, they are in a unique position to give something back to their customers when they are doing well. Together they can...
-
Data Engineer w/ Databricks
1 miesiąc temu
Warsaw, Polska IT LeasingTeam Sp. z o.o. Pełny etatIT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi konkurencyjnej....
-
Data Engineer w/ Databricks
4 tygodni temu
Warsaw, Polska IT LeasingTeam Sp. z o.o. Pełny etatIT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi konkurencyjnej....
-
Data Engineer
5 miesięcy temu
Warsaw, Polska release11 Pełny etatDołącz do nas jako Data Engineer (Kafka) i pracuj w skandynawskiej firmie z branży edukacyjnej, która realnie wpływa na naukę dzieci i młodzieży!Co tu znajdzieszKontrakt: umowa B2B;Lokalizacja: 100% praca zdalna na zawsze;Sprzęt: Linux lub Windows - Ty wybierasz (możesz też pracować na własnym sprzęcie);Skandynawskie podejście do pracy:...
-
Hadoop/Big Data Site Reliability Engineer
7 miesięcy temu
Warsaw, Polska VISA Pełny etatJob Description And Responsibilities Staff Site Reliability Engineer - Product Reliability Engineering Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second...
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska Sunscrapers sp. z o.o. Pełny etatAre you ready to take the challenge?We’re looking for a Senior Data Engineer to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska Addepto Pełny etatAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...
-
Senior Data Scientist/Data Engineer
2 miesięcy temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 26453 Would you like to be a co-driver in supporting our mission to protect the largest Nordic bank and its customers? Nordea’s Cyber Defence Centre Internal Threats team is looking for an experienced professional, willing to take a front seat in developing our existing big data and insider threat capability. At Nordea, we are committed...
-
Senior Data Engineer
21 godzin temu
Warsaw, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer , where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization. This position offers the opportunity to work on diverse...
-
Senior Data Engineer
5 miesięcy temu
Warsaw, Polska Chabre IT Services Sp. z.o.o Pełny etatWorking as a Senior Data Engineer, you will:Design and develop geospatial data pipelinesIntegrate various data sources to support construction site analyticsTake leading role in defining requirements, data architecture design and planningCollaborate with a team of developers and DevOps to enhance platform capabilitiesMaintain high quality and performance of...
-
Senior Data Engineer
7 miesięcy temu
Warsaw, Polska Ecovadis Pełny etatDescription We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...
-
Analityk Danych
6 miesięcy temu
Warsaw, Polska Warta Pełny etatObecnie poszukujemy kandydatów na stanowisko: Analityk Danych (Big Data) Miejsce pracy: Warszawa mazowieckie Numer Referencyjny: ADBD/Z/ML/ Do zadań osoby na tym stanowisku należeć będzie: administracja biznesowa narzędziami analitycznymi i rozwój środowiska statystycznego i analitycznego, przetwarzanie i transformacje danych z baz...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska IT Performance Pełny etatPoszukujemy kandydatów na stanowisko Senior Data Engineer. Praca jest dedykowana dla międzynarodowej firmy z obszaru technologii medycznych/farmacji.ObowiązkiProjektowanie, rozwijanie i utrzymywanie solidnych, skalowalnych i wydajnych Data/ETL PipelinówTworzenie i utrzymywanie modeli oraz architektury danych w celu zapewnienia integralności i optymalnej...
-
Senior Data Engineer
6 miesięcy temu
Warsaw, Polska emagine Consulting Pełny etatIndustry: Banking Work model: hybrid in Warsaw office (2 days a week working from home) Assignment Type: B2B Project Length: 12 months (extendable) Start Date: ASAP Project Language: English About a role: As a Senior Data Engineer, you will join a team that is part of the data platforms and services department. The domain is responsible...
-
Data Engineer
6 miesięcy temu
Warsaw, Polska Sanoma Pełny etat100% remote opportunity for candidates based in PolandSanoma Learning is the leading European learning company, serving over 20 million students in 11 countries. We offer printed and digital learning materials as well as digital learning and teaching platforms for primary, secondary, and vocational education. The development of our methodologies is based on...
-
Data Engineer
2 miesięcy temu
Warsaw, Polska Addepto Pełny etatAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...
