Senior Big Data Engineer
4 tygodni temu
Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in digital payments technology, it's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive.
We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.
Essential functions
Design and Develop Big Data Solutions : Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements. Data Ingestion and Processing : Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats. Optimize Data Pipelines : Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency. Cluster Management and Optimization : Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications. Real-Time Data Processing : Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making. Data Quality and Governance : Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems. Performance Tuning and Monitoring : Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.
Qualifications
Strong Programming Skills : Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala. Expertise in Big Data Technologies : Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase. Advanced Spark Knowledge : In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics. Data Modeling and ETL : Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies. Cluster Management Tools : Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling. SQL and NoSQL Databases : Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
We offer
Opportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Benefits package - medical insurance, sports Corporate social events Professional development opportunities Well-equipped office
About us
Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud migration, and application modernisation. Grid Dynamics achieves high speed-to-market, quality, and efficiency by using technology accelerators, an agile delivery culture, and its pool of global engineering talent. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, UK, Netherlands, Mexico, and Central and Eastern Europe. To learn more about Grid Dynamics, please visit www.griddynamics.com. Follow us on Facebook, Twitter, and LinkedIn.
-
Senior Data Engineer to work with Big Data
5 dni temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 25161 #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...
-
Senior Big Data Engineer
2 miesięcy temu
Warsaw, Polska Grid Dynamics Poland Pełny etattechnologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL MySQL PostgreSQL MongoDB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and...
-
Senior Big Data Engineer
4 tygodni temu
Warsaw, Polska Grid Dynamics Poland Pełny etatExpected, Scala, Java, Apache Hadoop, Apache Spark, Kubernetes, SQL, MySQL, PostgreSQL, MongoDB, Cassandra Operating system, Windows About the project, We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic...
-
Site Reliability Engineer
4 tygodni temu
Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etattechnologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...
-
Site Reliability Engineer
4 tygodni temu
Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etattechnologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...
-
Mid Big Data Engineer @ Capco Poland
4 dni temu
Warsaw, Polska Capco Poland Pełny etatWHY JOIN CAPCO? Employment contract and/or Business to Business - whichever you prefer Possibility to work remotely Speaking English on daily basis, mainly in contact with foreign stakeholders and peers Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance) Access to 3.000+ Business Courses Platform (Udemy) Access to...
-
Senior Big Data Engineer @ Neontri
4 tygodni temu
Warsaw, Polska Neontri Pełny etatCześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy...
-
Senior Big Data Engineer @ Neontri
4 tygodni temu
Warsaw, Polska Neontri Pełny etatCześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska VGW Pełny etatSenior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games. We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...
-
Specjalista Big Data
2 miesięcy temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Specjalista Big Data
4 tygodni temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Specjalista Big Data
2 tygodni temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Big Data Engineer
4 dni temu
Warsaw, Polska Integer Group Services Sp. z o.o Pełny etatBig Data Engineer Miejsce pracy: Warszawa Your responsibilities Building a platform for processing large amounts of data Building streaming solutions Construction and maintenance of data lake solutions, NoSQL databases Building CI/CD solutions, test automation CI/CD solutions, test automation Designing and maintaining ETL/ELT Applying good practices, code...
-
Big Data Engineer @ Orange Polska
4 tygodni temu
Warsaw, Polska Orange Polska Pełny etatAs a Big Data Engineer at Orange you will use your expertise in the field of Data solutions and data pipeline development to enable the processing of a significant volume of data for various stakeholders (including Data Visualization, Data Scientists, and Data Analysts) in the GSP (Global Support for Performance which is the GBS Finance of the Orange Group)....
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska Allegro Pełny etatThe salary range for this position is PLN in gross terms (contract of employment)A hybrid work model that incorporates solutions developed by the leader and the teamWe are looking for a Senior Data Engineer with a focus on the data processing and preparation, deployment and maintenance of our ML/data projects. Join our team to enhance your skills related to...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...
-
Big Data DevOps Engineer, Data Tooling team
2 tygodni temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 24291 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. As one of the biggest employers in the Nordics, Poland and Estonia, you have excellent opportunities to evolve, develop and move forward with us. We enable...
-
Senior Data Engineer
4 dni temu
Warsaw, Polska SwingDev Pełny etatWe are a Polish branch of a fast-growing InsurTech product company from Silicon Valley - Hippo Insurance. Our mission is to revolutionize home insurance in the US, starting from IoT monitoring devices to our industry-leading software. How do we want to get there? We need a top-notch talent, just like you! Putting a lot of effort into hiring top-tier...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Appcast Inc Pełny etatJob Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract...
