Senior Big Data Engineer

4 miesięcy temu

Warsaw, Polska Jit Team Pełny etat

Salary: 1000 - 1300 PLN/MD on B2B

Work model: 100% remote or hybrid from Warsaw

 

Why choose this offer?

  • You can expect a flexible work organization
  • The international work environment will give you the opportunity to interact with the English language on a daily basis
  • Scandinavian organizational culture will provide you with work-life balance, you will gain time for additional training (financed by Jit)
  • The Jit community will bring you a nice time during regular integration meetings

 

Project

This project focuses on providing first-level support and technical expertise to the DROC team, handling queries related to data engineering tasks. Responsibilities include executing ETL processes, refreshing UIs for data validation, and assisting with Spark/Hive queries for dataset analysis. When necessary, issues are classified and escalated to the appropriate teams, such as development or platform support. The project also involves working on Cloudera infrastructure, utilizing technologies like Scala, Spark, Hive, Oozie, and Elasticsearch to ensure efficient data processing and validation.

 

What you'll be doing

  • Take in queries from the DROC team and understand the request/ requirements
  • Be the first level of support
  • If the case cannot be resolved by oneself, triage/ classify the issues and identify which team to reach out to - dev team/ company platform team
  • Track and report the progress to DROC and PO
  • Execute ETL runs on DROC validation on Hadoop infrastructure
  • Refresh UIs for DROC validation using elastic search
  • Support DROC to write spark/ hive queries if needed to analyze a dataset
  • Support dev team and DROC team for config changes if specified by the relevant team

Expected competences and knowledge

  • Understand end to end ETL pipeline
  • Competent within data engineering principles
  • How to write Hive SQL (SPARK) queries
  • SCALA knowledge
  • Shell scripting
  • How to work on Cloudera distribution
  • Excellent knowledge of: Scala, Spark, Spark SQL, Cloudera, Hive, Oozie, Quantexa 
  • Familiar with but not needed to expert in: IntelliJ, Zeppelin, Bamboo, Jenkins, Nexus, Artifactory, Kafka
  • Basic knowledge how to work with Elasticsearch
  • Basic knowledge how to work on Cloudera distribution (Oozie) 

 

Technologies you'll work with

  • Scala
  • Spark
  • Spark SQL
  • Cloudera
  • Hive
  • Oozie
  • Quantexa 

 

Client – why choose this particular client from the Jit portfolio?

Jit Team has had an over-decade-long relationship with the leading financial group in the Nordic countries, and we are privileged to be our client's premier partner in Poland. At present, 150 Jit personnel are engaged in the completion of more than 60 projects for this Norwegian major provider of financial services with a global presence and a strong focus on modern technology. Our customer's work atmosphere is epitomized by the Scandinavian culture, which is conducive to people who place emphasis on work-life balance and feedback culture. Furthermore, all projects are executed in international teams, giving constant exposure to the English language. 

 

About Jit Team

The Human factor of IT - it's not just a slogan, it's a philosophy. The foundation of Jit Team is people, which is why we prioritise you. We employ over 500 experienced experts. We create highly specialised teams for clients from all over the world. We offer team members developmental projects, a wide range of benefits and a proprietary professional development programme.

Behind our maxim are also charitable and educational activities. We support pupils and students by donating learning equipment. We offer internships to help launch careers in IT. We support water rescuers and hospitals by providing the necessary equipment. We are a Polish company and we share what we have achieved over 13 years of activity. By supporting indigenous initiatives, we ensure the circulation of good energy.

 

  • Senior Big Data Engineer

    7 miesięcy temu

    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Senior Data Engineer

    7 miesięcy temu

    Warsaw, Polska VGW Pełny etat

    Senior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games.   We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...

  • Data Engineer w/ Databricks

    1 miesiąc temu

    Warsaw, Polska IT LeasingTeam Sp. z o.o. Pełny etat

    IT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi konkurencyjnej....

  • Data Engineer

    6 miesięcy temu

    Warsaw, Polska release11 Pełny etat

    Dołącz do nas jako Data Engineer (Kafka) i pracuj w skandynawskiej firmie z branży edukacyjnej, która realnie wpływa na naukę dzieci i młodzieży!Co tu znajdzieszKontrakt: umowa B2B;Lokalizacja: 100% praca zdalna na zawsze;Sprzęt: Linux lub Windows - Ty wybierasz (możesz też pracować na własnym sprzęcie);Skandynawskie podejście do pracy:...

  • Hadoop/Big Data Site Reliability Engineer

    7 miesięcy temu

    Warsaw, Polska VISA Pełny etat

    Job Description And Responsibilities Staff Site Reliability Engineer - Product Reliability Engineering   Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second...

  • Senior Data Engineer

    2 miesięcy temu

    Warsaw, Polska Sunscrapers sp. z o.o. Pełny etat

    Are you ready to take the challenge?We’re looking for a Senior Data Engineer to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust...

  • Senior Data Engineer

    2 miesięcy temu

    Warsaw, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Senior Data Engineer

    2 tygodni temu

    Warsaw, Polska Craftware Pełny etat

    Are you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer , where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization. This position offers the opportunity to work on diverse...

  • Senior Data Engineer

    7 miesięcy temu

    Warsaw, Polska Ecovadis Pełny etat

    Description We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...

  • Analityk Danych

    7 miesięcy temu

    Warsaw, Polska Warta Pełny etat

    Obecnie poszukujemy kandydatów na stanowisko: Analityk Danych (Big Data) Miejsce pracy: Warszawa mazowieckie Numer Referencyjny: ADBD/Z/ML/ Do zadań osoby na tym stanowisku należeć będzie: administracja biznesowa narzędziami analitycznymi i rozwój środowiska statystycznego i analitycznego, przetwarzanie i transformacje danych z baz...

  • Senior Data Engineer

    6 miesięcy temu

    Warsaw, Polska emagine Consulting Pełny etat

    Industry: Banking Work model: hybrid in Warsaw office (2 days a week working from home) Assignment Type: B2B Project Length: 12 months (extendable) Start Date: ASAP Project Language: English About a role: As a Senior Data Engineer, you will join a team that is part of the data platforms and services department. The domain is responsible...

  • Data Engineer

    6 miesięcy temu

    Warsaw, Polska Sanoma Pełny etat

    100% remote opportunity for candidates based in PolandSanoma Learning is the leading European learning company, serving over 20 million students in 11 countries. We offer printed and digital learning materials as well as digital learning and teaching platforms for primary, secondary, and vocational education. The development of our methodologies is based on...

  • Data Engineer

    2 miesięcy temu

    Warsaw, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Machine Learning Engineer

    3 miesięcy temu

    Warsaw, Polska Pareto Publishing - Make The Magic Happen Pełny etat

    Senior Machine Learning Engineer – Remote (Worldwide, Full-Time)Pareto Publishing is a leader in email marketing and financial advertising. We’re looking for a Senior Machine Learning Engineer to join our team. Responsibilities: Build and manage machine learning models to use email data and personalize client interactions Work with data teams to...

  • Senior Java Engineer

    4 miesięcy temu

    Warsaw, Polska Infotree Global Solutions Pełny etat

    Senior Java EngineerWhat will you do? Design and implement new regulatory reporting software supporting all global regulatory initiatives. The regulatory reports are crucial to the firm fulfilling the requirement of external regulatorsUse Java 17/Spring/Kafka/Singlestore technology stack to develop a horizontally scalable microservice systemSolve challenging...

  • Engineering Manager

    2 miesięcy temu

    Warsaw, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Cloud Data Engineer

    5 miesięcy temu

    Warsaw, Polska CCC Group Pełny etat

    Szukamy osób, które: Posiadają wykształcenie wyższe. Preferowany kierunek wykształcenia Informatyka.Mają Min. 2 lata doświadczenia w realizacji zadań jako Data Developer/Data Engineer / BIG DATA DeveloperMają praktyczną znajomość: MS-SQL Server, narzędzi MSBI (SSIS, SSAS, SSRS, Power BI, Power Query), Azure Data Factory, Azure Analysis Services...

  • Senior Python Developer

    1 miesiąc temu

    Warsaw, Polska in4ge Pełny etat

    Aktualnie dla naszego Klienta poszukujemy Senior Python Developera specjalizującego się w obszarze AI/ML i Big Data. Jeśli masz doświadczenie w tworzeniu skalowalnych rozwiązań do przetwarzania dużych zbiorów danych i chcesz rozwijać się w obszarze Machine Learning - zapraszamy do aplikowania!Dlaczego warto? Nasz Klient specjalizuje się w...

  • Data Engineer

    2 miesięcy temu

    Warsaw, Polska Visa Pełny etat

    Job DescriptionWhat's it all about?The Data Engineer will be part of an innovative Business Intelligence and Sales Tools Team within the VAS COO organization. The candidate is responsible for designing, building, and maintaining the infrastructure that supports data collection, storage, and processing. Ensures that data is accessible, reliable, and...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Bonapolia Pełny etat

     For job seekers, BONAPOLIA offers a gateway to exciting career prospects and the chance to thrive in a fulfilling work environment. We believe that the right job can transform lives, and we are committed to making that happen for you.  We are looking for a Senior Data Engineer to join our team and lead efforts in designing, implementing, and maintaining...