Data Engineer: Expert in Data Pipelines
2 dni temu
We are Transition Technologies MS, a company that values innovation and technology. We offer a unique opportunity for a highly skilled Data Engineer to join our team.
Salary: $120,000 - $150,000 per year (dependent on location and experience)
About the RoleThis is a challenging and rewarding role that requires expertise in data pipelines, SQL, and cloud technologies. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using various programming languages, including Python, R, and Java. You will also work closely with our data architecture team to ensure seamless integration with other systems.
Job Description
- Develop and maintain complex data pipelines using object-oriented programming principles and best practices.
- Design and implement efficient data processing solutions using SQL, NoSQL databases, and cloud storage services.
- Collaborate with cross-functional teams to identify business requirements and develop data-driven solutions.
Required Skills and Qualifications
- 3+ years of experience working with programming languages focused on data pipelines (e.g., Python, R).
- 3+ years of experience working with SQL and database management systems.
- 2+ years of experience in data pipeline maintenance and optimization.
- Experience working with different types of storage (filesystem, relational, MPP, NoSQL) and various kinds of data (structured, unstructured, metrics, logs, etc.).
- Strong understanding of data architecture concepts, including data modeling, metadata management, workflow management, ETL/ELT, real-time streaming, data quality, and distributed systems.
- Excellent knowledge of cloud technologies, including Airflow, Glue, Dataflow, and other smart solutions for handling data in the cloud.
- 1+ years of experience in Java and/or Scala.
- Experience working in Snowflake cloud environment.
- Very good knowledge of relational databases (optional).
- Very good knowledge of data serialization languages such as JSON, XML, YAML.
- Excellent knowledge of Git, Gitflow, and DevOps tools (e.g., Docker, Bamboo, Jenkins, Terraform).
- Capability to conduct performance analysis, troubleshooting, and remediation (optional).
- Excellent knowledge of Unix.
- Pharma data formats is a big plus (SDTM).
Benefits
- A great, non-corporate atmosphere.
- Stable employment conditions (contract of employment or B2B contract).
- Opportunities for development and promotion.
- Attractive package of benefits.
- Remote work.
-
Data Engineer for High-Performance Data Pipelines
1 miesiąc temu
Warszawa, Mazovia, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are seeking an experienced Data Engineer to contribute to the development of high-performance data pipelines at Grid Dynamics Poland Sp. z o.o.The ideal candidate will have expertise in handling large-scale data using technologies such as Cassandra, Kafka, Spark, and Scala.This is a unique opportunity to work on a high-impact project within a...
-
Data Engineer Bank Fraud Transformation Expert
4 tygodni temu
Warszawa, Polska ING Hubs Poland Pełny etat**Job Title:** Data Engineer Bank Fraud Transformation Expert**About the Role:We are looking for a skilled Data Engineer to join our team at ING Hubs Poland. As a Data Engineer, you will play a crucial role in designing and developing complex data pipelines using Apache Spark and Airflow.**Responsibilities:Design and implement efficient data processing...
-
Data Engineering Expert
2 miesięcy temu
Warszawa, Mazovia, Polska Allegro Pełny etatAllegro is a leading e-commerce platform in Poland, and we're looking for a skilled Data Engineer to join our team. As a Data Engineer at Allegro, you'll play a crucial role in shaping the future of our business by designing, developing, and maintaining robust data pipelines.
-
Cloud Data Engineering Expert
3 tygodni temu
Warszawa, Polska Link Group Pełny etatJob Title: Cloud Data Engineering ExpertAbout the Role:We are seeking an experienced Senior Cloud Data Engineer to join our prestigious team of professionals at Link Group. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale cloud-based data warehouses on the Google Cloud Platform...
-
Senior Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etatJob Title: Senior Data Engineer - Microsoft Azure ExpertAbout the Job:We are looking for a highly skilled Data Engineer to join our team at Procter and Gamble Polska Sp. z o.o. in Warsaw, Poland.Salary: Estimated salary range for this position is PLN 80,000 - 120,000 per month, depending on experience.Job Description: As a Data Engineer, you will be...
-
Junior Data Engineer
2 miesięcy temu
Warszawa, Polska B2B.net S.A Pełny etatOur customer is seeking a Junior Data Engineer to join a large, expert team focused on data architecture, analytics, and AI solutions. This long-term opportunity is ideal for candidates looking to grow within the field of data engineering.The project involves the ongoing development, maintenance, and support of customer’s Analytics...
-
Data Engineer
1 tydzień temu
Warszawa, mazowieckie, Polska Semantive Pełny etatWe are an independent multi-cloud services company that helps enterprises and SMB companies build new foundations for future growth through successful cloud transformation and breadth of expertise in applying cloud technologies to unlock new possibilities. Today's digital and technological revolution is an important part of our business - we are not only...
-
Data Engineer: Cloud-Native Data Expert
3 tygodni temu
Warszawa, Mazovia, Polska 7N Pełny etatAbout 7NAt 7N, we pride ourselves on our expertise in delivering high-end projects for leading US financial services companies. Our team of experienced professionals is dedicated to helping our clients achieve their goals through innovative solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer / Datalake Expert to join our team. As a...
-
Data Transformation Expert
1 miesiąc temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatSenior Data EngineerOur team at B2B S.A. is seeking a highly skilled Senior Data Engineer to join our organization.We are looking for an individual with experience in Spark & Python to define and maintain data ingestions and transformation.The ideal candidate will have a strong background in building distributed and highly parallelized big data processing...
-
Unlocking Data Excellence: Senior Data Engineer Opportunity
15 godzin temu
Nowy Świat , Warszawa, Polska SwingDev Pełny etatWe're a fast-growing InsurTech company from Silicon Valley, Hippo Insurance, expanding our presence in Poland. Our mission is to revolutionize home insurance in the US by combining IoT monitoring devices with industry-leading software.We're seeking a top-notch Senior Data Engineer to join our team and drive innovation in data quality. With a focus on...
-
Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatWe are seeking a highly skilled Data Engineer to join our team at Square One Resources Sp. z o.o. in a key project focused on developing data products and reporting solutions that support decision-making for organizations servicing diagnostic instruments.About the RoleAs a Data Engineer, you will be responsible for designing and optimizing data pipelines...
-
Data Engineer Expert for Global Beverage Industry
4 tygodni temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatWe are seeking a highly skilled Data Engineer to join our team at DCV Technologies, a global leader in the beverage industry.Estimated Salary: £80,000 - £100,000 per annumAbout the RoleThis is a fantastic opportunity to work on complex data processing applications using Microsoft Azure Synapse Spark Runtime and Scala programming language.You will be...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Data Engineer in Product Analytics Specialist
1 miesiąc temu
al. Jana Pawła II , Warszawa, Polska ING Hubs Poland Pełny etatAbout ING Hubs PolandING Hubs Poland is a major driving force in ING's transformation, aiming to help us become a data-driven digital leader and create tangible value for ING and its customers through world-class analytics models, products, and services.Job DescriptionWe are looking for a skilled Data Engineer to join our Product Analytics squad. As a Data...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska capital.com Pełny etatWe are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team. As a Data Engineer, you...
-
Senior Azure Databricks Data Engineer
2 tygodni temu
Domaniewska , Warszawa, Polska emagine Polska Pełny etatData Engineer (Azure Databricks) at emagine PolskaProject Overview:We are looking for a highly skilled Senior Azure Databricks Data Engineer to join our international Data team. The selected candidate will be responsible for designing, developing, and maintaining data pipelines in a scalable and performant manner.Responsibilities:Collaborate with an...
-
Cloud-Based Data Engineer
2 tygodni temu
Warszawa, Polska RITS Professional Services Pełny etatWe are seeking a skilled Cloud-Based Data Engineer to join our team at RITS Professional Services. Our company is a global, American, market-leading trading platform with over 25 years of experience helping leading asset managers, central banks, hedge funds, and other institutional investors access liquidity through electronic marketplaces.As a Cloud-Based...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Samba TV Pełny etatAbout Us:Samba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone. Our data enables media companies to connect with audiences for new shows and movies, and enables advertisers to engage viewers and measure reach across all their...
-
Cloud Data Engineer
2 dni temu
Warszawa, Polska Procter & Gamble Pełny etatAt Procter & Gamble, we're committed to innovation and leadership. As a Cloud Data Engineer, you'll play a critical role in designing, developing, and implementing data pipelines that acquire, cleanse, transform, and publish data to Databricks backend.Key Responsibilities:Designing and developing large, complex data sets that meet functional and...