Senior AWS Data Engineer

2 dni temu


Warsaw, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat
Senior AWS Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our team at SQUARE ONE RESOURCES sp. z o.o. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data.

About the Project

The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data (Real-World Data, RWD) using the EDIS end-to-end engine. The ideal candidate will possess a strong background in ETL processes, data modeling, and cloud technologies, particularly within the AWS ecosystem.

Responsibilities
  • Develop and enhance Data Warehouse solutions.
  • Design and implement ETL processes to ensure efficient data flow and storage.
  • Maintain and optimize data pipelines using various cloud technologies.
  • Collaborate with cross-functional teams to integrate and process biomedical data.
  • Conduct performance analysis, troubleshooting, and remediation of data-related issues.
  • Ensure data quality and adherence to architectural standards.
  • Utilize best practices in data architecture, including data modeling, metadata management, and workflow management.
Requirements
  • 4+ years in programming with a focus on data pipelines using Python or R.
  • 4+ years of experience working with SQL and relational databases.
  • 3+ years in maintaining data pipelines and handling various data types (structured, unstructured, metrics, logs).
  • 3+ years of experience in data architecture concepts, including ETL/ELT processes, real-time streaming, and data quality.
  • 3+ years of experience with cloud technologies and data pipeline solutions such as Airflow, Glue, and Dataflow.
  • Proficiency in AWS components such as S3, Redshift, DocumentDB, and DynamoDB.
  • Familiarity with different storage solutions (filesystem, relational, MPP, NoSQL).
  • Basic knowledge of Java and/or Scala (1+ years).
  • Strong understanding of data serialization languages like JSON, XML, and YAML.
  • Proficient in using Git, Gitflow, and DevOps tools (Docker, Bamboo, Jenkins, Terraform).
  • Excellent knowledge of Unix and its environment.

  • Senior AWS Data Engineer

    3 tygodni temu


    Warsaw, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    technologies-expected : Python ETL SQL Dataflow Airflow AWS Redshift DynamoDB Gitflow Bamboo Terraform about-project : We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is...

  • AWS Data Engineer

    3 tygodni temu


    Warsaw, Polska Senovo IT Pełny etat

    technologies-expected : AWS Databricks PySpark technologies-optional : Python about-project : Senovo IT is looking for an experienced Data Engineer with a strong background in AWS, Python, PySpark, and Databricks. You will be responsible for building and managing data pipelines and performing transformations for both batch and streaming data. The ideal...

  • AWS Data Engineer

    2 dni temu


    Warsaw, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ACAISOFT POLAND Sp. z o.o. in Warsaw. As a Data Engineer, you will play a key role in designing, building, and maintaining our data pipelines and systems.ResponsibilitiesDesign and implement data pipelines using AWS technologies such as Glue, Spark, and Lambda.Develop and...


  • Warsaw, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Senior AWS Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead our team in developing and enhancing Data Warehouse solutions. The ideal candidate will possess a strong background in ETL processes, data modeling, and cloud technologies, particularly within the AWS ecosystem.Key Responsibilities:Develop and enhance Data Warehouse...


  • Warsaw, Polska AltexSoft Pełny etat

    We are looking for an experienced Data Engineer with AWS experience to work on data infrastructure and analytical applications of our client. You’ll be part of a team dedicated to leveraging cloud technologies to enhance data processing and analytics capabilities. This position requires strong expertise in AWS services, DevOps practices, and advanced data...


  • Warsaw, Polska Nordcloud Pełny etat

    Join Nordcloud and make your mark on the European IT industry. Help our clients thrive on their cloud journey in solution areas such as infrastructure, migration, data, and security. Currently, we are looking for a Data Engineer to join our team in Poland. What we offer: Individual  training budget ,  exam fees  for partner certifications (AWS, Azure,...

  • AWS Data Engineer

    7 godzin temu


    Warsaw, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    About the ProjectWe are seeking a highly skilled Data Engineer to join our team at ACAISOFT POLAND Sp. z o.o. The ideal candidate will have a strong background in cloud computing, data engineering, and software development.ResponsibilitiesDesign and implement scalable data pipelines to ingest, transform, and publish data from various sources.Collaborate with...

  • Senior Data Engineer

    4 miesięcy temu


    Warsaw, Polska VGW Pełny etat

    Senior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games.   We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...

  • Senior Data Engineer

    1 miesiąc temu


    Warsaw, Polska EndySoft Pełny etat

    technologies-expected : Snowflake Data Cloud SQL Google Cloud Platform Git Jira Confluence AWS technologies-optional : Java Tableau Microsoft SSIS responsibilities : A Senior Data Engineer is responsible for designing, developing, and maintaining data infrastructure solutions within an organization. They play a crucial role in building and optimizing data...


  • Warsaw, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Senior Data EngineerSquare One Resources sp. z o.o. is seeking a highly skilled Senior Data Engineer to support the development of our blockchain crypto solution. As a key member of our team, you will play a crucial role in managing and leveraging large datasets, ensuring data integrity, and supporting blockchain audit-related tasks.Key...


  • Warsaw, Polska EPAM Systems Pełny etat

    We are looking for a Senior Data Integration Engineer to join our dynamic Data Practice team and collaborate on EPAM’s strategic projects. As a Senior Data Integration Engineer, you'll play a pivotal role in building data systems and applications that drive decision-making. Your main focus will be on developing and maintaining data pipelines and...

  • AWS Data Engineer

    6 dni temu


    Warsaw, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    technologies-expected : AWS Glue Apache Spark about-project : Hi there! If you’re looking for a high-impact position in an ambitious software house, we have a match for you! Our customer aims to build scalable data pipelines to ingest, transform, orchestrate, and publish our index data from over 200 suppliers. We are looking for a proficient Data Engineer...


  • Warsaw, Polska IT Performance Pełny etat

    Poszukujemy kandydatów na stanowisko Senior Data Engineer. Praca jest dedykowana dla międzynarodowej firmy z obszaru technologii medycznych/farmacji.ObowiązkiProjektowanie, rozwijanie i utrzymywanie solidnych, skalowalnych i wydajnych Data/ETL PipelinówTworzenie i utrzymywanie modeli oraz architektury danych w celu zapewnienia integralności i optymalnej...


  • Warsaw, Polska AWS EMEA SARL (Poland Branch) Pełny etat

    An AWS Technical Account Manager is a trusted advisor and cloud operations architect for our Enterprise Support customers. As a trusted advisor you’ll have a direct impact in helping our customers gain the most value from cloud technology. You’ll craft and execute strategies to drive our customers’ adoption and use of AWS services. This includes a...

  • AI Data Scientist

    4 dni temu


    Warsaw, Polska Cyclad Pełny etat

    technologies-expected : AWS Transcribe Anthropic LLMs about-project : We are seeking an experienced Data Scientist/AI Engineer to join our customers, a leading company in consulting, technology services, and digital transformation. Project information: Remote work: 100% remote Budget: 240 - 285 PLN/net/h + VAT Project: managing and improving systems that...

  • Senior Python Engineer

    3 miesięcy temu


    Warsaw, Polska 1dea Pełny etat

    Szukamy doświadczonego specjalisty od rozwiązań chmurowych (AWS) na stanowisko Senior Python Engineer (z GenAI + AWS), który lubi sięgać po nowe rozwiązania i ma głowę pełną pomysłów. Warunki zaangażowania: Branża projektu: Consulting ITLokalizacja: 100% zdalnieStart: ASAP (akceptujemy kandydatury z max 1msc okresem...

  • Lead / Senior AWS Engineer

    3 miesięcy temu


    Warsaw, Polska IT Performance Pełny etat

    Poszukujemy kandydatów na stanowisko Lead/Senior AWS Engineer. Praca jest dedykowana dla międzynarodowej firmy z obszaru farmacji / technologii medycznych. Projekt:"Platforma TRE (Trusted Research Environment) stworzonej na zamówienie na bazie Navify u klienta. Służy jako platforma udostępniania danych i analiz dla wewnętrznych i...

  • AWS DevOps Engineer

    4 miesięcy temu


    Warsaw, Polska IT Performance Pełny etat

    Poszukujemy kandydatów na stanowisko AWS DevOps Engineer. Praca jest dedykowana dla międzynarodowej firmy z obszaru farmacji/technologii medycznych.Projekt:"Business Insights Technologies (BITe) Usługi profesjonalne, które tworzą rozwiązania oparte na sztucznej inteligencji oraz ekosystemy budowane, ulepszane i utrzymywane w celu rozwiązywania...

  • Senior Data Engineer

    1 tydzień temu


    Warsaw, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    technologies-expected : Python Databricks PySpark Airflow Azure Docker NoSQL Data lake CI/CD about-project : Our client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a...


  • Warsaw, Polska 7N Sp. z o.o. Pełny etat

    Senior Data EngineerWe are seeking a highly skilled and motivated Senior Data Engineer to join our growing data team at 7N Sp. z o.o. The ideal candidate will have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products.Key Responsibilities:Develop Data Pipelines: Design, develop,...