Hadoop Big Data Developer

Hadoop Big Data Developer Miejsce pracy: Gdańsk Technologies we use Expected Scala Apache Spark Apache Hadoop Yarn Sqoop Hive IMPALA MapReduce Oozie SQL Git Jenkins Bamboo Ansible Linux Shell Bash Oracle Java Optional Apache Flink Apache Kafka AWS Microsoft Azure Python Grafana Prometheus ELK Stack Elasticsearch Logstash Kibana Jupyter zeppelin Docker Kubernetes Terraform Anible Apache Airflow NiFi Google Cloud Platform Operating system Linux About the project We are looking for an experienced Hadoop / Big Data Developer with the potential to grow into an Expert IT Developer role. You will join the Backend Application Capability Team, which supports key initiatives within the IT/Technology cluster of a client from the banking industry. Our team provides technical expertise across Hadoop/Big Data, Oracle, SQL, and Java technologies, driving data-driven transformation and innovation across the organization. Your responsibilities Design, develop, and maintain data pipelines and applications using Hadoop and related Big Data technologies Work closely with architects, analysts, and other developers to deliver high-quality, scalable solutions Participate in system design reviews, requirement refinements, and technical discussions Optimize existing processes for performance, scalability, and reliability Ensure code quality through testing, code reviews, and adherence to best practices Collaborate within the Scrum/SAFe team to deliver business value incrementally and continuously Our requirements At least 3 years of experience with Java 8 and/or Scala Hands-on experience with Apache Spark Proficiency in SQL and Linux Shell scripting Solid knowledge of the Hadoop ecosystem, including: YARN, Sqoop, Hive, Impala, MapReduce, Oozie, etc. Version control and CI/CD tools such as Git, Ansible, Bamboo, or Jenkins Strong understanding of data processing and distributed computing principles Fluent English Residing in Poland required Optional Experience with functional programming principles (Scala preferred) Exposure to real-time streaming technologies, such as Apache Flink or Apache Kafka Familiarity with data analysis and data modelling Understanding of the SAFe Agile framework and Agile delivery principles Experience with cloud environments (AWS, Azure, or GCP) Familiarity with Python for data manipulation or automation tasks Knowledge of monitoring and logging tools (Grafana, Prometheus, ELK stack) What we offer Great Place to Work since 2015 - it's thanks to feedback from our workers that we get this special title and constantly implement new ideas Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022 Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more Comfortable workplace – class A offices or remote work Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers Investment in your growth – meetups, webinars, training platform and technology blog – you choose Fantastic atmosphere created by all Sii Power People Recruitment stages Send your CV Talk to us about your expectations Learn more about our projects and choose the best Start your adventure with Sii Sii Sp. z o.o. Sii is the leading technology consulting, digital transformation, engineering, and business services vendor in Poland. We already employ more than 7 500 professionals and implement projects in a variety of industries for clients from many countries around the world. The Great Place to Work title, won 10 times in a row, proves that at Sii we create a friendly work environment.