Senior AWS Data Engineer
4 miesięcy temu
We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data (Real-World Data, RWD) using the EDIS end-to-end engine. The ideal candidate will possess a strong background in ETL processes, data modeling, and cloud technologies, particularly within the AWS ecosystem.
Senior AWS Data Engineer
Your responsibilities
- Develop and enhance Data Warehouse solutions.
- Design and implement ETL processes to ensure efficient data flow and storage.
- Maintain and optimize data pipelines using various cloud technologies.
- Collaborate with cross-functional teams to integrate and process biomedical data.
- Conduct performance analysis, troubleshooting, and remediation of data-related issues.
- Ensure data quality and adherence to architectural standards.
- Utilize best practices in data architecture, including data modeling, metadata management, and workflow management.
Our requirements
- 4+ years in programming with a focus on data pipelines using Python or R.
- 4+ years of experience working with SQL and relational databases.
- 3+ years in maintaining data pipelines and handling various data types (structured, unstructured, metrics, logs).
- 3+ years of experience in data architecture concepts, including ETL/ELT processes, real-time streaming, and data quality.
- 3+ years of experience with cloud technologies and data pipeline solutions such as Airflow, Glue, and Dataflow.
- Proficiency in AWS components such as S3, Redshift, DocumentDB, and DynamoDB.
- Familiarity with different storage solutions (filesystem, relational, MPP, NoSQL).
- Basic knowledge of Java and/or Scala (1+ years).
- Strong understanding of data serialization languages like JSON, XML, and YAML.
- Proficient in using Git, Gitflow, and DevOps tools (Docker, Bamboo, Jenkins, Terraform).
- Excellent knowledge of Unix and its environment.
- Experience with pharmaceutical data formats (SDTM).
Aplikuj
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, Polska B2B.net S.A Pełny etatSenior Data EngineerYour responsibilities Working with Spark & Python to define and maintain data ingestions and transformation Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatOur client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large...
-
Senior Data Platform Engineer
2 miesięcy temu
Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etatWe are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable...
-
Data Engineer for Scalable Infrastructure
3 tygodni temu
Warszawa, Polska Billennium Pełny etatSenior Data EngineerAs a Senior Data Engineer at Billennium, you will design and develop our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you will optimize data flows, enhance data quality, and support analytics and machine learning projects.Key Responsibilities:Build and...
-
Senior Data Engineering Leader
2 tygodni temu
Warszawa, Mazovia, Polska B2B S.A Pełny etatJob Title: Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team at B2B S.A. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data ingestion and transformation pipelines using...
-
Data Engineer Senior
3 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatProjekt dla firmy z branży konsultingowej. Klientem docelowym jest firma międzynarodowa, z Wielkiej Brytanii.Data Engineer Senior / ArchitectTwój zakres obowiązków Praca głównie z DataBricks Wizualizacja danych na potrzeby weryfikacji poprawności i testowanie...
-
Senior Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Senior Data Solutions Architect for AWS and Snowflake
1 miesiąc temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatJob Description:We are seeking a Senior Data Solutions Architect with expertise in designing, developing, and implementing data products and data pipeline solutions based on AWS and Snowflake platforms.Key Responsibilities:Leading the technical architecture and design of data products and data pipeline solutions on the AWS platform to ensure scalability,...
-
Senior Big Data Engineer
1 tydzień temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatJob Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, Polska Craft Pełny etatAbout The RoleCraft is seeking a skilled Data Engineer to join a team responsible for a key product within the organization. As a core member of this team, you will have a significant impact on how solutions are engineered and delivered. Craft empowers engineers with a great deal of responsibility, matched by our investment in their growth and...
-
Data Engineer Expert for Cloud-Native Data Platform
4 tygodni temu
Warszawa, Mazovia, Polska 7N Pełny etat7N Consultants are seeking a seasoned Senior Data Engineer to join our team in Warsaw. As a key member of our data engineering squad, you will be responsible for designing, building, deploying, and maintaining a web-scale, cloud-native data platform.We are looking for an expert with at least 5+ years of recent hands-on professional experience working as a...
-
Lead Data Infrastructure Specialist
7 dni temu
Warszawa, Polska Billennium Pełny etatSenior Data Engineer Role at BillenniumWe are looking for a highly skilled Senior Data Engineer to join our team at Billennium. The successful candidate will be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency.Key Responsibilities:Data Pipeline Architecture: Build and maintain data pipeline...
-
Senior Big Data Engineer
2 tygodni temu
Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etatJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...
-
Data Engineer for US Investment Firm
3 tygodni temu
Warszawa, Polska Sunscrapers Pełny etatSunscrapers is a leading software development company that's expanding its presence in data-centric environments.We're looking for a Senior Data Engineer to join our team in Warsaw or remotely. This position offers a competitive compensation package and the opportunity to advance your career with a talented team that's changing the image of Poland abroad.The...
-
DevOps Engineer AWS
4 miesięcy temu
Warszawa, mazowieckie, Polska ERGO Technology & Services Pełny etatAbout UsERGO Technology & Services S.A. (ET&S S.A.) was established in January 2021 following the integration of ERGO Digital IT and Atena into one entity, leveraging both companies’ strengths and best practices. As a part of ERGO Technology & Services Management AG, the technology holding of ERGO Group AG, we support millions of internal and external...
-
Data Engineer: Cloud-Native Data Expert
2 tygodni temu
Warszawa, Mazovia, Polska 7N Pełny etatAbout 7NAt 7N, we pride ourselves on our expertise in delivering high-end projects for leading US financial services companies. Our team of experienced professionals is dedicated to helping our clients achieve their goals through innovative solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer / Datalake Expert to join our team. As a...
-
Senior Azure Databricks Data Engineer
4 dni temu
Domaniewska , Warszawa, Polska emagine Polska Pełny etatData Engineer (Azure Databricks) at emagine PolskaProject Overview:We are looking for a highly skilled Senior Azure Databricks Data Engineer to join our international Data team. The selected candidate will be responsible for designing, developing, and maintaining data pipelines in a scalable and performant manner.Responsibilities:Collaborate with an...
-
Senior Azure Data Platform Engineer
2 miesięcy temu
Warszawa, Polska HAYS Pełny etatSenior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...
-
Senior DevOps Engineer
1 miesiąc temu
Warszawa, Polska HAYS Pełny etatSenior DevOps EngineerWarszawaNR REF.: 1190131Senior DevOps Engineer (CoE, Hybrid work model from Warsaw)We are on the lookout for a Senior DevOps Engineer to spearhead the design, implementation, and upkeep of our DevOps practices and cloud infrastructure. This pivotal role demands a deep understanding of cloud infrastructure and a proven history of...