Data Engineer Spark

2 tygodni temu

Poznań, Greater Poland Opensignal Pełny etat

Job title: Data Engineer (Spark)

Department: Engineering

Reporting to: Engineering Manager

Location: Poland

Purpose of Role

We're searching for a Data Engineer (Spark) to join our Market Performance Group in converting our real-world raw data into valuable industry leading metrics that offer insights to our analysts and customers.

Responsibilities

  • Manage and enhance our big data pipelines in AWS Spark.
  • Create large, intricate data sets adhering to engineering best practices.
  • Develop scalable and durable data infrastructure and tools to extract and transform data for stakeholders and customers.
  • Collaborate with data scientists and data engineers to innovate products measuring market dynamics in the Telecommunication sector, influencing customer marketing tactics and acquisition strategies.

Requirements:

  • 3+ years of experience in building and optimizing big data pipelines using Apache Spark
  • Proficiency in Python, Java and relational SQL databases
  • Experience with DB technologies such as MSSQL, Postgres, AWS Athena (Presto), Redshift
  • 1+ years of unit testing experience
  • Familiarity with AWS services like EC2, S3, EMR
  • Strong analytical skills in handling unstructured datasets
  • Ability to analyze data for specific business inquiries
  • Experience in cross-functional teamwork, with excellent communication and collaboration abilities
  • Bachelor's degree
  • English language proficiency (B2 or higher)

Preferred Qualifications:

  • Knowledge of Scala
  • Experience with data workflow tools like Apache Airflow
  • Background in AWS solution architecture
  • Experience implementing complex models on large datasets for new product development

About Us

Opensignal is a prominent global provider of independent insight and data on network experience and performance. Our user-focused approach helps communication providers enhance their networks and maximize performance. Our impartial analysis is highly regarded by analysts and institutions, contributing to their reports.

Real network experience drives customer decisions. Our goal is to advance connectivity for all, leading the industry in linking network experience and market performance.

With offices in London, Boston, and Victoria, British Columbia, we have a global presence, with employees from over 25 nationalities across four continents. We promote diversity and inclusivity in our workforce.

Benefits

We value diversity and inclusion, offering a flexible remote-hybrid work approach. Additional benefits include:

  • 95% remote work - team meets in Warsaw office once a month
  • Warsaw office at Marina Mokotów with great amenities
  • Private family healthcare, Multisport Card

Tech Stack:

  • Spark, Python, Scala, SQL, Redshift, Athena, S3, Airflow, EMR

Salary Range:

  • 20,000 PLN - PLN on B2B

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Sigma Software Pełny etat

    Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMER Sigma Software provides top-quality software development, graphic design, testing, and support services.Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming,...

  • Senior Spark/Scala Engineer

    2 tygodni temu

    Poznań, Greater Poland Symphony Industrial AI, Inc. Pełny etat

    IntroductionWe seek a Senior Spark/Scala Engineer to join our international teamThe successful candidate will be part of the SymphonyAI NetReveal Product Engineering group, which builds products and solutions enabling Financial Institutions to detect and respond to Financial Crime activity found in their data in a scalable and comprehensive way.This role...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Rite NRG Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland MindPal Pełny etat

    Technologies-expected : Python SQL AWS about-project : We are looking for a Data Engineer to join the team at Mind Pal, working for our key client in the technology sector.We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Senior Data Engineer z

    2 tygodni temu

    Poznań, Greater Poland dmTECH Polska Pełny etat

    Senior Data Engineer z j.niemieckim Poznań, Województwo wielkopolskie Senior Data Engineer z j.niemieckim Poznań Poznań, Województwo wielkopolskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii...

  • Senior Data Engineer z jniemieckim

    2 tygodni temu

    Poznań, Greater Poland dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Poznań, Województwo wielkopolskie Senior Data Engineer z jniemieckim Poznań Poznań, Greater Poland Voivodeship, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Datumo Pełny etat

    Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects . Our team...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland ROCKWOOL Group Pełny etat

    We are seeking a Data Engineer position based in our Poznań location to join the R&D team. Ready to help build a better future for generations to come? In an ever-changing, fast paced world, we owe it to ourselves and our future generations to live life responsibly. At ROCKWOOL, we work relentlessly to enrich modern living through our innovative stone...

  • Senior Data Engineer @

    2 tygodni temu

    Poznań, Greater Poland Capgemini Polska Sp. z o.o. Pełny etat

    Capgemini Engineering is a world leader in engineering and R&D services. We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds. Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are a responsible and...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Shaped Thoughts Pełny etat

    We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.Who are we?We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us, despite a...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    Data Engineer We are seeking a talented Data Engineer with 4+ years of experience to join our dynamic team. The ideal candidate will be passionate about transforming raw data into valuable insights and possess a strong proficiency in SQL, T-SQL, and various data manipulation and visualization tools. If you're looking for an opportunity to work with...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Mindpal Pełny etat

    Technologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at Mind Pal, working for our key client in the technology sector.We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland CLOUDFIDE Pełny etat

    ABOUT USAt CLOUDFIDE, we do everything with data and contribute to pivotal projects for Fortune 500 companies. This is your chance to enhance your skills and leave your global footprint.Our collaborative culture champions your professional growth. Dive into cloud data processing, gain hands-on big data experience, and leverage our team's expertise to drive...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Lite e-Commerce Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Informacje: Lokalizacja: Poznań Poznań, Greater Poland Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Poznań - Ciekawe oferty pracy w okolicy:PoznańOferty pracy w okolicznych lokalizacjachPoznań: Inne...

  • Sr QA Automation Engineer

    2 tygodni temu

    Poznań, Greater Poland Egnyte Pełny etat

    Description Senior QA Automation Engineer [Poznań, Poland] EGNYTE YOUR CAREER. SPARK YOUR PASSION. Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With 22,000 customers worldwide and growing, you can make an impact by protecting their valuable data. When...

  • Senior Data Engineer Flink

    2 tygodni temu

    Poznań, Greater Poland GetInData | Part of Xebia Pełny etat

    Senior Data Engineer Flink Poznań, Województwo wielkopolskie Senior Data Engineer Flink Poznań Poznań, Greater Poland Voivodeship, Polska Informacje: Lokalizacja: Poznań Poznań, Greater Poland Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Poznań - Ciekawe oferty pracy w okolicy:PoznańOferty pracy w okolicznych...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Ework Group Pełny etat

    We are seeking a skilled and experienced Data Engineer to join our client (pharmaceutical area) team. The ideal candidate will have a strong background in data architecture, data modeling, data warehousing and ETL processes. The Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports our organization's...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland j-labs Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala...

  • Azure Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    We are currently looking for a Azure Data Engineer, who wishes to join our project.The main tasks will be: Develop and deploy data warehouse solution in Azure Cloud Design and implement data ingestion to Azure Storage services Creation of data transformations using Data Factory, Synapse Analytics, DatabricksRequired skillset: Azure Data Factory Azure Data...

  • GCP Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Groupe SII Pełny etat

    Join one of the largest financial organizations in the world as a Data Engineer. As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process. Your role Developing software projects and applications in...