Senior AWS Data Engineer

4 miesięcy temu


Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data (Real-World Data, RWD) using the EDIS end-to-end engine. The ideal candidate will possess a strong background in ETL processes, data modeling, and cloud technologies, particularly within the AWS ecosystem.

Senior AWS Data Engineer


Your responsibilities

  • Develop and enhance Data Warehouse solutions.
  • Design and implement ETL processes to ensure efficient data flow and storage.
  • Maintain and optimize data pipelines using various cloud technologies.
  • Collaborate with cross-functional teams to integrate and process biomedical data.
  • Conduct performance analysis, troubleshooting, and remediation of data-related issues.
  • Ensure data quality and adherence to architectural standards.
  • Utilize best practices in data architecture, including data modeling, metadata management, and workflow management.

Our requirements

  • 4+ years in programming with a focus on data pipelines using Python or R.
  • 4+ years of experience working with SQL and relational databases.
  • 3+ years in maintaining data pipelines and handling various data types (structured, unstructured, metrics, logs).
  • 3+ years of experience in data architecture concepts, including ETL/ELT processes, real-time streaming, and data quality.
  • 3+ years of experience with cloud technologies and data pipeline solutions such as Airflow, Glue, and Dataflow.
  • Proficiency in AWS components such as S3, Redshift, DocumentDB, and DynamoDB.
  • Familiarity with different storage solutions (filesystem, relational, MPP, NoSQL).
  • Basic knowledge of Java and/or Scala (1+ years).
  • Strong understanding of data serialization languages like JSON, XML, and YAML.
  • Proficient in using Git, Gitflow, and DevOps tools (Docker, Bamboo, Jenkins, Terraform).
  • Excellent knowledge of Unix and its environment.
  • Experience with pharmaceutical data formats (SDTM).

Aplikuj

 


  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, mazowieckie, Polska Billennium Pełny etat

    As a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...

  • Senior Data Engineer

    2 miesięcy temu


    Warszawa, Polska B2B.net S.A Pełny etat

    Senior Data EngineerYour responsibilities Working with Spark & Python to define and maintain data ingestions and transformation Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured...

  • Senior Data Engineer

    3 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Our client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large...


  • Warszawa, Polska Grid Dynamics Poland Sp. z o.o. Pełny etat

    We are seeking a Senior Data Platform Engineer to build and refine data ingestion systems that ensure reliable data flow for analytics and product development. The role involves using Infrastructure as Code and AWS services to automate and manage infrastructure. Proficiency in Python and PySpark is required. You will design scalable...


  • Warszawa, Polska Billennium Pełny etat

    Senior Data EngineerAs a Senior Data Engineer at Billennium, you will design and develop our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you will optimize data flows, enhance data quality, and support analytics and machine learning projects.Key Responsibilities:Build and...


  • Warszawa, Mazovia, Polska B2B S.A Pełny etat

    Job Title: Senior Data EngineerJob Summary:We are seeking an experienced Senior Data Engineer to join our team at B2B S.A. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data ingestion and transformation pipelines using...

  • Data Engineer Senior

    3 miesięcy temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Projekt dla firmy z branży konsultingowej. Klientem docelowym jest firma międzynarodowa, z Wielkiej Brytanii.Data Engineer Senior / ArchitectTwój zakres obowiązków Praca głównie z DataBricks Wizualizacja danych na potrzeby weryfikacji poprawności i testowanie...

  • Senior Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Craftware Pełny etat

    Are you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...


  • Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Job Description:We are seeking a Senior Data Solutions Architect with expertise in designing, developing, and implementing data products and data pipeline solutions based on AWS and Snowflake platforms.Key Responsibilities:Leading the technical architecture and design of data products and data pipeline solutions on the AWS platform to ensure scalability,...

  • Senior Big Data Engineer

    1 tydzień temu


    Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...

  • Senior Data Engineer

    3 miesięcy temu


    Warszawa, Polska Craft Pełny etat

    About The RoleCraft is seeking a skilled Data Engineer to join a team responsible for a key product within the organization. As a core member of this team, you will have a significant impact on how solutions are engineered and delivered. Craft empowers engineers with a great deal of responsibility, matched by our investment in their growth and...


  • Warszawa, Mazovia, Polska 7N Pełny etat

    7N Consultants are seeking a seasoned Senior Data Engineer to join our team in Warsaw. As a key member of our data engineering squad, you will be responsible for designing, building, deploying, and maintaining a web-scale, cloud-native data platform.We are looking for an expert with at least 5+ years of recent hands-on professional experience working as a...


  • Warszawa, Polska Billennium Pełny etat

    Senior Data Engineer Role at BillenniumWe are looking for a highly skilled Senior Data Engineer to join our team at Billennium. The successful candidate will be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency.Key Responsibilities:Data Pipeline Architecture: Build and maintain data pipeline...

  • Senior Big Data Engineer

    2 tygodni temu


    Aleje Jerozolimskie A, Warszawa, Polska Link Group Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer with at least 5 years of experience in designing, implementing, and optimizing large-scale data processing pipelines. The ideal candidate will leverage Apache Spark and Python to develop efficient ETL pipelines for big data analysis.Key Responsibilities:Develop, test, and maintain...


  • Warszawa, Polska Sunscrapers Pełny etat

    Sunscrapers is a leading software development company that's expanding its presence in data-centric environments.We're looking for a Senior Data Engineer to join our team in Warsaw or remotely. This position offers a competitive compensation package and the opportunity to advance your career with a talented team that's changing the image of Poland abroad.The...

  • DevOps Engineer AWS

    4 miesięcy temu


    Warszawa, mazowieckie, Polska ERGO Technology & Services Pełny etat

    About UsERGO Technology & Services S.A. (ET&S S.A.) was established in January 2021 following the integration of ERGO Digital IT and Atena into one entity, leveraging both companies’ strengths and best practices. As a part of ERGO Technology & Services Management AG, the technology holding of ERGO Group AG, we support millions of internal and external...


  • Warszawa, Mazovia, Polska 7N Pełny etat

    About 7NAt 7N, we pride ourselves on our expertise in delivering high-end projects for leading US financial services companies. Our team of experienced professionals is dedicated to helping our clients achieve their goals through innovative solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer / Datalake Expert to join our team. As a...


  • Domaniewska , Warszawa, Polska emagine Polska Pełny etat

    Data Engineer (Azure Databricks) at emagine PolskaProject Overview:We are looking for a highly skilled Senior Azure Databricks Data Engineer to join our international Data team. The selected candidate will be responsible for designing, developing, and maintaining data pipelines in a scalable and performant manner.Responsibilities:Collaborate with an...


  • Warszawa, Polska HAYS Pełny etat

    Senior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...

  • Senior DevOps Engineer

    1 miesiąc temu


    Warszawa, Polska HAYS Pełny etat

    Senior DevOps EngineerWarszawaNR REF.: 1190131Senior DevOps Engineer (CoE, Hybrid work model from Warsaw)We are on the lookout for a Senior DevOps Engineer to spearhead the design, implementation, and upkeep of our DevOps practices and cloud infrastructure. This pivotal role demands a deep understanding of cloud infrastructure and a proven history of...