Data Engineer with Databricks

Data Engineer with Databricks Miejsce pracy: Toruń Technologies we use Expected Databricks Unity Catalog Azure Data Factory Microsoft SQL Server Azure DevOps Azure Storage Apache Spark Optional Azure Key Vault Azure Functions Azure Stream Analytics GitHub Apache Hadoop Hive IoT Hub Azure Cybersecurity Python About the project Be part of a cutting-edge biotech project that combines advanced data engineering with real-world impact. You will work on creating scalable data systems and infrastructure that support groundbreaking molecular biology research. Partnering with a global leader in biotechnology, you will deliver advanced data analytics and AI-driven solutions that help transform the field. No prior experience in the biotech domain? No problem You will quickly get up to speed with the industry-specific knowledge needed to succeed. Apply now and join the journey to shape the future of biotechnology Your responsibilities Building and optimizing advanced analytics data pipelines using Python or Scala, ensuring efficient data ingestion and processing Implementing scalable solutions with big data technologies such as Hadoop, Hive, or Spark to manage and analyze large datasets Designing secure, high-performance data architectures on the Microsoft Azure platform, utilizing services like Azure Databricks, Azure Data Factory, Azure Storage, and Azure Stream Analytics to build efficient data workflows Applying best practices in data modelling, security, and provisioning across all layers of the data architecture, including Azure Key Vault, SQL Server, and Azure Functions for secure and optimized data handling Collaborating with data scientists, engineers, and domain experts to develop proof-of-concept solutions and innovative AI-driven applications, integrating tools like Azure DevOps and GitHub for efficient project management and version control Our requirements Senior-level experience in data engineering, with expertise in building advanced analytics pipelines Strong coding skills in Python or Scala, and hands-on experience with SQL Familiarity with big data technologies such as Hadoop, Hive, or Spark Solid understanding of data modelling, security best practices, and provisioning concepts Hands-on experience with a range of Azure technologies, including but not limited to: Azure Databricks & Unity Catalog, Azure Data Factory, IoT Hub, Azure DevOps, Azure Key Vault, Azure Functions, SQL Server, and Azure Cybersecurity and Networking configurations Proficiency in English at a B2 level or higher Fluent Polish required Residing in Poland required What we offer Great Place to Work since 2015 - it's thanks to feedback from our workers that we get this special title and constantly implement new ideas Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022 Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more Comfortable workplace – class A offices or remote work Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers Investment in your growth – meetups, webinars, training platform and technology blog – you choose Fantastic atmosphere created by all Sii Power People Recruitment stages Send your CV Talk to us about your expectations Learn more about our projects and choose the best Start your adventure with Sii Sii Sp. z o.o. Sii is the leading technology consulting, digital transformation, engineering, and business services vendor in Poland. We already employ more than 7 300 professionals and implement projects in a variety of industries for clients from many countries around the world. The Great Place to Work title, won 10 times in a row, proves that at Sii, we create a friendly work environment. Sii ensures that all employment-related decisions are made solely on the basis of qualifications and competencies. We are committed to equal treatment of all individuals, regardless of any protected characteristics, and promote a diverse and inclusive work environment.