Senior Data Engineer Spark
1 miesiąc temu
Job title: Senior Data Engineer (Spark)
Department: Engineering
Reporting to: Engineering Manager
Location: Poland
Purpose of Role
We’re looking for a Senior Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers.
What you will be doing
Own and improve our big data pipelines in AWS Spark.
Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.
Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.
Work closely with our data scientists and our data engineers to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies.
We're looking for:
5+ years of experience with building and optimizing big data pipelines in Apache Spark
5+ years of experience with Python and Java
Advanced with relational SQL databases and SQL
3+ years of experience with one of DB: MSSQL, Postgres, AWS Athena (Presto), Redshift
3+ years of experience in writing unit tests
Experience with AWS cloud services like EC2, S3, EMR or equivalent
Strong analytic skills in working with unstructured datasets.
Experience in root cause analysis of data when asked to answer specific business questions
Experience working with cross-functional teams
Strong communication and collaboration skills
Bachelor’s degree
English (B2 or higher)
It'd be nice to have:
Experience with Scala
Experience with DBT
Experience with data pipeline / workflow tools i.e. Apache Airflow
Experience in AWS solution architecture
Experience in implementing complex clustering and classification models on large datasets to support new product development
About Us
Opensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance. Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.
Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never before been possible.
With offices in London, Boston and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.
Benefits
We believe we are stronger when we not only celebrate our many differences, values, and voices but include them in everyday practice. Having a diverse and inclusive culture is essential, which is why we offer a flexible approach to work-life balance, operating in a remote-hybrid way. We also offer an attractive range of additional benefits, including:
95% remotely - the team meets in the Warsaw office for 1 day/month
Warsaw office at Marina Mokotów in a leafy and quiet estate just around the corner from Pole Mokotowskie.
Kitchen, free coffee, shower, summer barbecues.
Comprehensive private family health care package
Multisport Card
Tech stack
Spark, Python, Scala,DBT, SQL, Redshift, Athena, S3, Airflow, EMR
Salary ranges:
25 000 PLN – 34 000 PLN on B2B
Mamy inne aktualne oferty pracy związane z tym obszarem, które można znaleźć poniżej
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska Opensignal Pełny etatJob title: Senior Data Engineer (Spark)Department: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Senior Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Opensignal Pełny etatJob title: Senior Data Engineer (Spark)Department: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Senior Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our...
-
Data Engineer
1 miesiąc temu
Warsaw, Polska Opensignal Pełny etatJob title: Data Engineer (Spark)Department: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers. What...
-
Data Engineer
4 tygodni temu
Warsaw, Polska Opensignal Pełny etatJob title: Data Engineer (Spark)Department: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers. What...
-
Senior Spark
2 tygodni temu
Warsaw, Polska ComScore (via CC) Pełny etatCorrect Context is looking for Senior Spark Scala/Java Developer for Comscore in Poland and around.Comscore is global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...
-
Data Engineer
2 miesięcy temu
Warsaw, Polska CGI Pełny etatPosition Description: Obecnie poszukujemy doświadczonego Data Engineera, który będzie odpowiedzialny za projektowanie, tworzenie i utrzymanie infrastruktury danych. Osoba na tym stanowisku będzie zaangażowana w budowę i zarządzanie rozwiązaniami opartymi na technologiach Pythona, AWS, Spark, Databricks oraz analizie danych. Idealnie abyś...
-
Data Engineer
4 tygodni temu
Warsaw, Polska CGI Pełny etatPosition Description: Obecnie poszukujemy doświadczonego Data Engineera, który będzie odpowiedzialny za projektowanie, tworzenie i utrzymanie infrastruktury danych. Osoba na tym stanowisku będzie zaangażowana w budowę i zarządzanie rozwiązaniami opartymi na technologiach Pythona, AWS, Spark, Databricks oraz analizie danych. Idealnie abyś...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska Digital Turbine Pełny etatSenior Data Engineer Warsaw, PolandEMEA – AGP Tech /Regular /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Appcast Inc Pełny etatJob Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Appcast Pełny etatJob DescriptionThe Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska Be in IT Pełny etattechnologies-expected :PythonSparkSQLtechnologies-optional :HadoopHiveNoSQLDataikuAzureS3TalendLinuxJavaabout-project :Długofalowa współpraca z międzynarodową, topową firmą consultingową, świadcząca usługi IT dla dużych i średnich firm z różnorodnych sektorów jak automotive, finanse, bankowość czy produkcja. Wiodący projekt realizowany...
-
Senior Data Engineer
2 godzin temu
Warsaw, Polska Limango Polska Pełny etatSenior Data Engineer @ Limango Remote/Wroclaw B2B contract â daily rate 900-1250pln Your role and main tasks Development of Central Lakehouse Data Platform based on AWS / Databricks ecosystem Managing data infrastructure (Terraform AWS / Databricks) and ETL code (PySpark, Delta Live Tables, SparkSQL) Implementing monitoring, data quality tests, unit...
-
Senior Data Engineer @
2 tygodni temu
Warsaw, Polska Link Group Pełny etatLooking for an opportunity to be part of a dynamic team driving innovation in the financial sector? We're currently seeking a Data Engineer to join our team focused on combating financial crime. In this role, you'll collaborate closely with data experts to deliver insights vital for protecting our clients.Responsibilities:Develop and maintain data pipelines...
-
Senior Data Engineer to work with Big Data
1 tydzień temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 25161 #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...
-
Senior Big Data Engineer
2 miesięcy temu
Warsaw, Polska Grid Dynamics Poland Pełny etattechnologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL MySQL PostgreSQL MongoDB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and...
-
Senior Data Engineer
1 tydzień temu
Warsaw, Polska DATUMO sp. z o.o. Pełny etatSenior Data Engineer Miejsce pracy: Warszawa Technologies we use Expected Google Cloud Platform Azure DevOps AWS Big Data Apache Airflow Apache Spark Snowflake Data Cloud Python Scala Optional Docker Kafka Databricks Your responsibilities Our team members tend to stick around for more than 3 years, and when a project wraps up, we don't let them go - we...
-
Data Engineer
3 tygodni temu
Warsaw, Polska Digital Turbine Pełny etatData Engineer Warsaw, PolandEMEA – AGP Tech /Regular /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska Opensignal Pełny etatJob title: Senior Data EngineerDepartment: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers. What...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Opensignal Pełny etatJob title: Senior Data EngineerDepartment: EngineeringReporting to: Engineering ManagerLocation: Poland Purpose of RoleWe’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers. What...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska Digital Turbine Pełny etatSenior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...
