Scala Spark Developer

1 tydzień temu

Gdańsk, Trójmiasto, Polska DAC.digital Pełny etat 23 zł

At DAC.digital, we are constantly growing our business. As part of our growth strategy, we are strengthening our strategic partnership with an exchange organization that provides markets, infrastructure, and services for trading financial instruments.


Key information:

Salary:

For Senior:

  • 23 000 - 27 000 PLN net/month - pure B2B contract

  • 20 000 – 24 000 PLN net/month – B2B contract (days off included)

For Lead (10+ years of experience):

  • 27 000 - 34 000 PLN net/month - pure B2B contract

  • 24 000 – 30 000 PLN net/month – B2B contract (days off included)


It is vital that you have:

  • 5+ years of experience;

  • proficiency in Scala for developing robust, scalable backend and data-processing applications;

  • strong experience with Apache Spark;

  • proficiency with Apache Kafka;

  • knowledge of English (min. B2);

  • working in agile methodologies (Scrum, Kanban);

  • high communication skills;;

  • eager to learn and share knowledge;

  • willing to travel if necessary (conferences, coworking events, etc.).


Nice to have:

  • hands-on experience with Big Data platforms and practical knowledge of the Cloudera ecosystem;

  • experience with Google Cloud Platform (e.g., Cloud Run & Kubernetes);

  • experience in Power BI / Report Builder.


Technology stack:

  • Scala

  • Spark

  • Kafka


You will be responsible for supporting our team in:

  • designing, building, and maintaining scalable data-processing solutions using Scala and Apache Spark, including job orchestration, performance tuning, partitioning strategy, and efficient resource usage in distributed environments;

  • collaborating with data engineering and platform teams to deliver production-ready pipelines, streaming components, and system integrations aligned with business and technical requirements;

  • ensuring reliable data streaming and event-driven architectures with Apache Kafka, including topic design, consumer/producer flows, schema management, and end-to-end monitoring;

  • optimizing pipeline performance and cost by profiling bottlenecks in Spark jobs, improving parallelism, reducing shuffle overhead, and implementing efficient data storage and serialization formats;

  • producing and maintaining clear technical documentation, including pipeline specifications, coding standards, deployment workflows, data contracts, and troubleshooting runbooks.


What do we offer:

  • possibility to work 100% remotely or on-site at our office in Gdańsk;

  • b2b contract with included 30 days off;

  • private Medical care;

  • group insurance;

  • pre-paid card or Sport Card;

  • referral program;

  • real Agile practices;

  • employee well-being online platform;

  • cafeteria benefits.


  • Senior Scala Developer

    4 dni temu

    Gdańsk, pomorskie, Trójmiasto, Polska Jit Team sp. z o.o. Pełny etat

    Senior Scala DeveloperMiejsce pracy: GdańskTechnologies we useExpectedScalaOptionalPrometheusGrafanaELK stackAbout the projectSalary: 1100 - 1300 PLN/day on B2BWork model: hybrid from Gdynia / Gdańsk / Warszawa (2/3 days per week from the office)The project focuses on building and optimizing large-scale data processing pipelines in a complex financial...

  • Hadoop Big Data Developer

    3 tygodni temu

    Gdańsk, pomorskie, Trójmiasto, Polska Sii Sp. z o.o. Pełny etat

    Hadoop Big Data DeveloperMiejsce pracy: GdańskTechnologies we useExpectedScalaApache SparkApache HadoopYarnSqoopHiveIMPALAMapReduceOozieSQLGitJenkinsBambooAnsibleLinuxShellBashOracleJavaOptionalApache FlinkApache KafkaAWSMicrosoft AzurePythonGrafanaPrometheusELK StackElasticsearchLogstashKibanaJupyterzeppelinDockerKubernetesTerraformAnibleApache...

  • Senior Hadoop Big Data Developer

    1 tydzień temu

    Gdańsk, Trójmiasto, Polska DCG Pełny etat

    Responsibilities:Work on assigned project tasks within a SAFe Agile environment, collaborating closely with cross-functional teamsTake ownership of development activities across the Hadoop / Big Data ecosystem to deliver high-quality, scalable solutionsCollaborate with team members and stakeholders to ensure alignment, knowledge sharing, and customer-focused...

  • Cloud Data Architect

    6 dni temu

    Gdańsk, pomorskie, Trójmiasto, Polska Capgemini Polska Pełny etat

    Cloud Data ArchitectMiejsce pracy: GdańskTechnologies we useExpectedCloud DataflowBigQueryCloud DataprocCloud KMSPub/SubGoogle Kubernetes EngineApache BeamKafkaSparkSnowflakeData Lake Gen2Event HubData FactoryDatabricksAzure DWHAzure FunctionPower BITerraformRedshiftGlueAthenaKinesisLambdaPythonScalaJavaBashOperating systemWindowsLinuxAbout the projectYou...

  • Senior Java Engineer

    6 dni temu

    Gdańsk, Trójmiasto, Polska Scalac Pełny etat 5 zł - 40 zł

    B2B | Hybrid | Location: Gdańsk or Warsaw (1–2 times every two months in the office )Project: Modernization of a banking systemRate: 30-50€/hWe’re looking for a Java Engineer/Data Engineer to join a project focused on modernizing and optimizing a long-standing legacy system. The current architecture cannot keep up with growing business demands, and...

  • AWS Data Engineer

    2 tygodni temu

    Gdańsk, pomorskie, Trójmiasto, Polska Capgemini Polska Pełny etat

    AWS Data EngineerMiejsce pracy: GdańskTechnologies we useOperating systemWindowsAbout the projectJoin our Insights & Data team, a community of over 400 professionals delivering impactful, data-driven solutions. We specialize in building scalable cloud-native data architectures and pipelines that power analytics and machine learning across various...

  • Senior Scala Developer

    4 dni temu

    Gdańsk, Polska B2B.NET S.A. Pełny etat

    technologies-expected : - Scala - Apache Spark - Airflow - Oozie - Docker - Kubernetes - Git - Bitbucket - Bamboo - Gradle - Maven - HDFS - Hive - Parquet - JSON - CSV - XML - ScalaTest - Specs2 - ScalaCheck technologies-optional : - Prometheus - Grafana - ELK stack - Graph Analytics about-project : - Jako Senior Scala Developer będziesz odpowiedzialny...

  • Java Scala Developer with Big Data

    2 tygodni temu

    Gdańsk, Polska emagine Polska Pełny etat

    Project information: Industry:: banking B2B: up to 170 zł/h (depend on experience) Start: ASAP/to determinate Location: Warsaw/ Lodz/ Gdańsk or Gdynia (2-3 days per week in the office) Summary: We are looking for a Senior Hadoop/Big Data Developer to join our Backend Application team, focusing on key IT projects within the Group Business Support cluster....

  • Big Data Developer

    1 tydzień temu

    Gdańsk, Pomerania, Polska B2B S.A Pełny etat 1 200 000 zł - 1 800 000 zł rocznie

    Jako Big Data Developer dołączysz do zespołu Backend Application Capability, który wspiera kluczowe projekty i inicjatywy w ramach GBS (Group Business Support) – IT/Technology Cluster, dostarczając wiedzę oraz kompetencje w zakresie rozwoju platform i oprogramowania.Lokalizacja: 2 razy w tygodniu z biura w Trójmieście, Warszawie lub ŁodziBig Data...

  • Hadoop Big Data Developer

    3 tygodni temu

    Gdańsk, Polska Sii Sp. z o.o. Pełny etat

    Hadoop Big Data Developer Miejsce pracy: Gdańsk Technologies we use Expected - Scala - Apache Spark - Apache Hadoop - Yarn - Sqoop - Hive - IMPALA - MapReduce - Oozie - SQL - Git - Jenkins - Bamboo - Ansible - Linux - Shell - Bash - Oracle - Java Optional - Apache Flink - Apache Kafka - AWS - Microsoft Azure - Python - Grafana - Prometheus - ELK...

  • IT Developer

    2 tygodni temu

    Gdańsk, Polska B2Bnetwork Pełny etat

    Nasz klient, międzynarodowa organizacja finansowa, rozwija nowoczesne rozwiązania w obszarze Big Data i Hadoop, wspierając kluczowe projekty w ramach GBS – IT/Technology Cluster. Jako Big Data Developer dołączysz do zespołu zajmującego się budową i optymalizacją platformy danych, która wspiera kluczowe procesy biznesowe. Tworzenie i rozwój...

  • Lead Pega Business Architect

    2 tygodni temu

    Gdańsk, Polska B2B.net S.A Pełny etat

    Poszukujemy doświadczonego Analityka Biznesowego-Systemowego / Architekta Biznesowego z mocną wiedzą w technologii Pega. Osoba na tym stanowisku będzie odpowiadać za projektowanie procesów oraz architekturę biznesowych aplikacji w ramach projektu Corporate Lending, wspierając rozwój i implementację rozwiązań w Pega.Lead Pega Business...

  • Lead Data Engineer Data Architect

    2 tygodni temu

    Gdańsk, Polska Xebia sp. z o.o. Pełny etat

    designing, building and optimizing the data ingestion pipeline to reliably deliver billions of events daily in defined SLA, identifying and addressing pain points in the existing data platform; developing new tools and frameworks to streamline the data platform workflows, driving adoption of best practices in data and software engineering (testing, CI/CD,...

  • Engineer IT

    2 tygodni temu

    Gdańsk, Polska H2B Group Pełny etat

    We are a consulting company that helps clients automate business processes using AI, while supporting IT professionals in developing their careers within the B2B model. We offer projects across industries such as fintech, medtech, edutech, and industrial automation. Through close collaboration, we drive our clients’ growth by delivering fast and measurable...

  • Data & BI Software Engineer

    1 tydzień temu

    Gdańsk, Pomerania, Polska Spyrosoft Pełny etat 80 000 zł - 120 000 zł rocznie

    Requirements:Experience in any SQL (or similar)Knowledge of BI tools (particularly Power BI)Ability to design data modelsOptimizing interactive dashboards and reportsFamiliarity with ETL/ELT processesExperience with GCP, especially Looker and LookMLData governance principles and experience in monitoring data qualityFluency in English and PolishJob...

  • Senior Java Developer

    2 tygodni temu

    Gdańsk, Polska Jit Team Pełny etat

    Salary: up to 1600 PLN/ MD na B2B Working model: 100% remote or hybrid Warsaw/ Poznań/ Kraków/ Rzeszów/ Gdynia    Build a brand-new AdTech platform , shaping the core architecture and setting technical standards for a major e-commerce organization Work directly with cutting-edge advertising ecosystems (Meta, TikTok, Google) and gain rare hands-on...