Hadoop Big Data Developer

3 tygodni temu


Warsaw, Polska Sii Sp. z o.o. Pełny etat

Hadoop Big Data Developer

Miejsce pracy: Warszawa

Technologies we use

Expected

- Scala
- Apache Spark
- Apache Hadoop
- Yarn
- Sqoop
- Hive
- IMPALA
- MapReduce
- Oozie
- SQL
- Git
- Jenkins
- Bamboo
- Ansible
- Linux
- Shell
- Bash
- Oracle
- Java

Optional

- Apache Flink
- Apache Kafka
- AWS
- Microsoft Azure
- Python
- Grafana
- Prometheus
- ELK Stack
- Elasticsearch
- Logstash
- Kibana
- Jupyter
- zeppelin
- Docker
- Kubernetes
- Terraform
- Anible
- Apache Airflow
- NiFi
- Google Cloud Platform

Operating system

- Linux

About the project

We are looking for an experienced Hadoop / Big Data Developer with the potential to grow into an Expert IT Developer role. You will join the Backend Application Capability Team, which supports key initiatives within the IT/Technology cluster of a client from the banking industry. Our team provides technical expertise across Hadoop/Big Data, Oracle, SQL, and Java technologies, driving data-driven transformation and innovation across the organization.

Your responsibilities

- Design, develop, and maintain data pipelines and applications using Hadoop and related Big Data technologies
- Work closely with architects, analysts, and other developers to deliver high-quality, scalable solutions
- Participate in system design reviews, requirement refinements, and technical discussions
- Optimize existing processes for performance, scalability, and reliability
- Ensure code quality through testing, code reviews, and adherence to best practices
- Collaborate within the Scrum/SAFe team to deliver business value incrementally and continuously

Our requirements

- At least 3 years of experience with Java 8+ and/or Scala
- Hands-on experience with Apache Spark
- Proficiency in SQL and Linux Shell scripting
- Solid knowledge of the Hadoop ecosystem, including: YARN, Sqoop, Hive, Impala, MapReduce, Oozie, etc.
- Version control and CI/CD tools such as Git, Ansible, Bamboo, or Jenkins
- Strong understanding of data processing and distributed computing principles
- Fluent English
- Residing in Poland required

Optional

- Experience with functional programming principles (Scala preferred)
- Exposure to real-time streaming technologies, such as Apache Flink or Apache Kafka
- Familiarity with data analysis and data modelling
- Understanding of the SAFe Agile framework and Agile delivery principles
- Experience with cloud environments (AWS, Azure, or GCP)
- Familiarity with Python for data manipulation or automation tasks
- Knowledge of monitoring and logging tools (Grafana, Prometheus, ELK stack)

What we offer

- Great Place to Work since 2015 - it’s thanks to feedback from our workers that we get this special title and constantly implement new ideas
- Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market
- We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022
- Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more
- Comfortable workplace – class A offices or remote work
- Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application
- PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers
- Investment in your growth – meetups, webinars, training platform and technology blog – you choose
- Fantastic atmosphere created by all Sii Power People

Recruitment stages

- Send your CV
- Talk to us about your expectations
- Learn more about our projects and choose the best
- Start your adventure with Sii

Sii Sp. z o.o.

Sii is the leading technology consulting, digital transformation, engineering, and business services vendor in Poland. We already employ more than 7 500 professionals and implement projects in a variety of industries for clients from many countries around the world.

The Great Place to Work title, won 10 times in a row, proves that at Sii we create a friendly work environment.


  • Hadoop Big Data Developer

    2 tygodni temu


    Warsaw, Polska Sii Sp. z o.o. Pełny etat

    Hadoop Big Data Developer Miejsce pracy: Warszawa Technologies we use Expected Scala Apache Spark Apache Hadoop Yarn Sqoop Hive IMPALA MapReduce Oozie SQL Git Jenkins Bamboo Ansible Linux Shell Bash Oracle Java Optional Apache Flink Apache Kafka AWS Microsoft Azure Python Grafana Prometheus ELK Stack Elasticsearch Logstash Kibana Jupyter zeppelin Docker...


  • Warsaw, Polska DCG Pełny etat

    Responsibilities: Work on assigned project tasks within a SAFe Agile environment, collaborating closely with cross-functional teams Take ownership of development activities across the Hadoop / Big Data ecosystem to deliver high-quality, scalable solutions Collaborate with team members and stakeholders to ensure alignment, knowledge sharing, and...

  • Hadoop Developer

    2 tygodni temu


    Warsaw, Polska Sii Sp. z o.o. Pełny etat

    Hadoop Developer Miejsce pracy: Warszawa Technologie, których używamy Wymagane Apache Spark Java SQL Linux Hadoop Git Ansible Jenkins System operacyjny Linux O projekcie Dołącz do projektu realizowanego dla sektora finansowego, w którym rozwijamy strategiczne rozwiązania oparte na analizie i przetwarzaniu danych na dużą skalę. Pracując w naszym...


  • Warsaw, Polska emagine Polska Pełny etat

    Project information: Industry:: banking B2B: up to 170 zł/h (depend on experience) Start: ASAP/to determinate Location: Warsaw/ Lodz/ Gdańsk or Gdynia (2-3 days per week in the office) Summary: We are looking for a Senior Hadoop/Big Data Developer to join our Backend Application team, focusing on key IT projects within the Group Business Support cluster....

  • Big Data Engineer

    1 tydzień temu


    Warsaw, Polska GOLDENORE ITC sp. z o.o. Pełny etat

    technologies-expected : - Spark - Python - Scala - Hadoop - SQL - Hive - Kudu - HBase - Iceberg - Maven technologies-optional : - Jira - Confluence - Kubeflow - Kafka - Apache Nifi about-project : - Dołączysz do zespołu, który pracuje nad najbardziej zaawansowanymi inicjatywami Big Data w bankowości. Jesteśmy 12-osobowym zespołem Scrumowym,...

  • Big Data Engineer

    5 dni temu


    Warsaw, Polska GOLDENORE ITC sp. z o.o. Pełny etat

    Big Data Engineer Miejsce pracy: Warszawa Technologie, których używamy Wymagane Spark Python Scala Hadoop SQL Hive Kudu HBase Iceberg Maven Mile widziane Jira Confluence Kubeflow Kafka Apache Nifi System operacyjny Linux O projekcie Dołączysz do zespołu, który pracuje nad najbardziej zaawansowanymi inicjatywami Big Data w bankowości. Jesteśmy...

  • Big Data Developer

    5 dni temu


    Warsaw, Polska 7N Pełny etat

    Dla naszego klienta, który od lat wyznacza kierunek rozwoju bankowości elektronicznej w Polsce poszukujemy doświadczonego Big Data Developera , który będzie projektować, tworzyć i optymalizować kluczowe mechanizmy streamingowe, wspierające procesy analityczne i operacyjne. Lokalizacja: 90% praca zdalna z dowolnego miejsca w Polsce. Spotkania...


  • Warsaw, Polska VISA Pełny etat

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Architekt Big Data

    4 tygodni temu


    Warsaw, Polska ITHOUSE SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Architekt Big Data Miejsce pracy: Warszawa Technologie, których używamy Wymagane Jira Confluence Enterprise Architect Twój zakres obowiązków Projektowanie architektury obszarów i rozwiązań w organizacji zgodnie z przyjętą strategią; Zgłaszanie inicjatyw w zakresie poprawy jakości rozwiązań; Konsultacje na potrzeby realizowanych projektów....


  • Warsaw, Polska Cyclad Pełny etat

    technologies-expected : - Hadoop - Elasticsearch - Kafka - Logstash - Kibana - Red Hat - Enterprise Architect technologies-optional : - HBase - Hive - Knox - Ranger - Oozie about-project : - In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting edge technologies that shape the world of...