Senior Data Engineer

2 tygodni temu


Katowice, Silesia, Polska SAVENTIC HEALTH sp. z o.o. Pełny etat
Senior Data Engineer
Katowice
Katowice, Silesian Voivodeship, Polska

Introduction to Saventic:

Saventic Health - we are an international scale-up company focusing on innovations in rare diseases. We create algorithms, based on artificial intelligence, to support the diagnosis of rare diseases. We represent a unique team of professionals in medicine, science, technology, and management.

Currently, we are looking for an experienced Data Engineer to develop our analytical capabilities. We plan to perform the implementation of a new architecture combining data extraction from medical centers, data quality verification, creation of a feature store and upload of the data to the database. Additionally, we aim to develop a platform, one of the functionalities of which will be the detection of clinical symptoms in patients who, do not have specific phrases written in their medical description. In the next stages, we plan to develop a large model that will be the core for finding rare diseases.

Position that we offer:

  • Development and maintenance of ETL processes, data pipelines in "BIG DATA" architecture
  • Creation and maintenance of data pipelines: receiving data from medical units and structuring data in an internal database
  • Expansion of tools supporting data quality control processes
  • Optimization of data processing processes and SQL query optimization
  • Automation of data delivery processes to the data warehouse
  • Monitoring data delivery and processing processes
  • Creation of Data Lake, Data Mart and Feature Store for visualization and modeling purposes
  • Creation of a pipeline for data processing in the scope of CI/CD

Required Qualification:

  • MD in Engineering, Computer Science, Math, Statistics or related fields
  • 5+ years of relevant experience (can be mixed industry and academic)
  • Practical experience in working with on-premise environments
  • Work in the "BIG DATA" methodology
  • Experience using: Linux, Git, Python, Terraform, Docker, and Kubernetes
  • Experience tools: Kedro, Soda, Great Expectations, Airflow
  • Experience in designing and creating optimal ETL processes in the Big Data domain
  • Practical knowledge of SQL
  • Good programming skills in Python
  • Commercial experience in implementing ETL processes on-premises
  • Understanding of the data model lifecycle

Our offer:

  • Start-up culture
  • Internationals projects that make a real impact on patients' lives
  • Challenging job in multidisciplinary environment
  • Benefits package
Firma: SAVENTIC HEALTH sp. z o.o.

Dodano:
Praca na stanowisku - aktualna

Praca Katowice - Ciekawe oferty pracy w okolicy:
#J-18808-Ljbffr

  • Katowice, Silesia, Polska Kalepa Pełny etat

    Senior Backend Data Engineer Katowice, Silesian Voivodeship Senior Backend Data Engineer Katowice Katowice, Silesian Voivodeship, Polska Who are we?Kalepa is a fully remote startup dedicated to enhancing underwriting performance and driving profitable premium growth for the commercial insurance industry. Kalepa's AI-powered Copilot software enables...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    Company DescriptionVattenfall is a European energy company with a long history of powering industries and homes through innovation. The company is committed to transitioning to fossil-free energy and is seeking talented individuals to join their mission.Job DescriptionTeam – Analytics Hub We are a diverse international team of data professionals working on...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall IT Services PL Pełny etat

    Senior Data Engineer Katowice, Silesian Voivodeship Team – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the job Team – Analytics Hub Building, deploying and maintaining end-to-end, scalable and reliable analytics solutions. Performing requirement engineering with the business to determine their exact needs. Designing, developing and maintaining data pipelines and ETL processes that ingest, transform and load data from various sources into...

  • Senior Data Engineer

    1 miesiąc temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall GmbH Pełny etat

    Job DescriptionTeam – Analytics HubWe are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Mid Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Interia Sp. z o.o. Pełny etat

    Mid Senior Data Engineer Katowice, śląskie jest czołowym graczem na polskim rynku mediów nowej generacji. Co miesiąc ponad 21 mln osób korzysta z dostępu do najświeższych informacji, ciekawostek i rozrywki oraz z najlepszego sposobu komunikowania się ze światem.Działamy w ramach Grupy Polsat Plus, lidera rynku mediów i telekomunikacji w Polsce,...


  • Katowice, Silesia, Polska Data Reply Pełny etat

    Using powerful and state-of-the-art open source and cloud technologies work on scalable, cost-effective and flexible solutions for our customers. Build and deploy infrastructure and applications for complex data projects. Engage with innovative topics such as artificial intelligence, cloud, IoT, analytics, next-gen DBs. Advise our customers in...

  • Senior PHP Developer

    2 tygodni temu


    Katowice, Silesia, Polska Transparent Data Pełny etat

    Senior PHP Developer Katowice Katowice, Silesian Voivodeship, Polska Transparent Data to unikalna kombinacja mocnej technologii i doświadczenia w pracy z danymi. Wykorzystujemy dane z otwartych rejestrów dotyczących danych gospodarczych by dostarczać usługi i produkty dla klientów biznesowych. Tworzymy rozwiązania m. in dla. największych instytucji...

  • Senior Big Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Capgemini Pełny etat

    Capgemini Engineering is a world leader in engineering and R&D services. We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds. Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are responsible and...

  • Data engineer

    4 tygodni temu


    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:have experience with data modelling and data integration, building and managing dashboards in Power BI (min. 3 years) have knowledge of Cloud environment and data analytics on Cloud (Azure preferably) and you are cloud focused have a basic knowledge of Windows Server management with regards to patching, compliance monitoring,...

  • Data engineer

    2 miesięcy temu


    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:have experience with data modelling and data integration, building and managing dashboards in Power BI (min. 3 years) have knowledge of Cloud environment and data analytics on Cloud (Azure preferably) and you are cloud focused have a basic knowledge of Windows Server management with regards to patching, compliance monitoring,...

  • Data engineer

    2 tygodni temu


    Katowice, Silesia, Polska ING Bank N.V. Pełny etat

    We are looking for you, if you:have experience with data modelling and data integration, building and managing dashboards in Power BI (min. 3 years)have knowledge of Cloud environment and data analytics on Cloud (Azure preferably) and you are cloud focusedhave a basic knowledge of Windows Server management with regards to patching, compliance monitoring,...

  • Data engineer

    2 tygodni temu


    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you: have experience with data modelling and data integration, building and managing dashboards in Power BI (min. 3 years) have knowledge of Cloud environment and data analytics on Cloud (Azure preferably) and you are cloud focused have a basic knowledge of Windows Server management with regards to patching, compliance...

  • Senior AI ML Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Sii Pełny etat

    Senior AI ML Engineer Katowice, Silesian Voivodeship Senior AI ML Engineer Katowice Katowice, Silesian Voivodeship, Polska Join Sii and help develop highly specialized software and IT tools for legal, tax, accounting, trading, and compliance professionals, in conjunction with the world's largest information serviceAs a Senior AI/ML Engineer, you will be part...

  • Senior DevOps Engineer @

    2 tygodni temu


    Katowice, Silesia, Polska Power Media Pełny etat

    Nasz klient kompleksowo realizuje usługi w zakresie konsultingu, projektowania i zarządzania projektami. Specjalizuje się głównie w obszarach e-commerce, data management (Agile Data Warehouse, Data Governance) oraz Content Management.Aktualnie poszukujemy dla niego ambitnej, samodzielnej osoby na stanowisko DevOps EngineerMiejsce pracy : Możliwość...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Comeon Group Pełny etat

    ComeOn Group in shortFounded in 2008, ComeOn Group is a leading global player in the rapidly growing iGaming market. Having launched its first online brand in 2010, ComeOn Group is running a wide range of exciting brands across multiple markets. Managing a multi brand portfolio on its proprietary platform providing a secure, innovative and entertainment-led...

  • software engineer

    2 tygodni temu


    Katowice, Silesia, Polska Data Reply Pełny etat

    As part of our team, you help our customers. successfully design and implement complex solution architectures for mission-critical data analysis and real-time applications. Using powerful and state-of-the-art open source and cloud technologies work on scalable, cost-effective and flexible solutions for our customers. To provide automation and...