Azure Data Engineering Expert

Azure Data Engineering Expert Miejsce pracy: Kraków Technologies we use Expected Python Microsoft Azure Polars Pandas Pyspark PowerBI Optional Database knowledge Operating system Windows Linux About the project YOUR TEAM Insights & Data delivers state-of-the-art Data solutions. Our expertise primarily lies in Cloud & Big Data engineering, where we develop robust systems capable of processing extensive and complex datasets, utilizing specialized Cloud Data services across platforms like AWS, Azure, and GCP. We oversee the entire Software Development Life Cycle (SDLC) of these solutions, which involves not only leveraging data processing tools such as ETL but also extensive programming in languages like Python, Scala, or Java, coupled with the adoption of DevOps tools and best practices. The processed data is then made accessible to downstream systems through APIs, outbound interfaces, or is visualized via comprehensive reports and dashboards. Additionally, within our AI Center of Excellence, we undertake Data Science and Machine Learning projects with a focus on cutting-edge areas such as Generative AI, Natural Language Processing (NLP), Anomaly Detection, and Computer Vision. YOUR TASKS Project aims at integrating and harmonize data from strategic platforms into our global data platform. We look for a data engineer to create, maintain and improve pipelines from source to harmonized layer and from harmonized layer to consumption layer for Power BI reporting. Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. Business domains covered are around commercial insurance pricing & underwriting. Your responsibilities Developing new functionality within the Python-based ETL pipeline Ongoing maintenance and optimization of existing pipelines Planning the capacity and sizing of service components, as well as proactively managing cloud components Initiating the planning and setup of new service components Coordinating the operations and maintenance of related software, complex server infrastructure, and databases (such as Synapse, PowerBI, and local development environments) Service-related documentation must be maintained in accordance with customer technology standards Monitoring services and managing SLA performance will be an ongoing task Processes and configurations related to the environments must be documented, maintained, and optimized Collaboration with various stakeholders, including development, architecture, rollout, and operations teams, as well as customers, will be necessary for managing releases, upgrades, and changes Our requirements strong experience in data engineering very good experience with data-oriented Python (Polars, Pandas, Pyspark) very good experience with Microsoft Azure, especially Synapse is a plus Solid understanding of cloud architecture ITIL Strong analytical skills and customer focus Can rapidly adapt and respond to changes in environment and priorities Advanced English is a must Excellent communication skills with high customer focus Desirable: Database knowledge, PowerBI knowledge, experience in Bl Projects & DataVault 2.0 What we offer Practical benefits: permanent employment contract from the first day; hybrid, flexible working model; equipment package for home office; private medical care with Medicover; life insurance; Capgemini Helpline; NAIS benefit platform; Access to 70 training tracks with certification opportunities; platform with free access to Pluralsight, TED Talks, Coursera, Udemy Business and SAP Learning HUB Community Hub that will allow you to choose from over 20 professional communities that gather people interested in, among others: Salesforce, Java, Cloud, IoT, Agile, AI. Benefits sharing the costs of sports activities private medical care life insurance no dress code parking space for employees extra social benefits redeployment package employee referral program charity initiatives access to courses e.g. Excel, VBA, RPA, Customer Care unlimited access to Udemy Business free chat/call with a therapist Recruitment stages Interview with the recruiter Competency Tests/Language Verification Video call with a manager Final Decision Capgemini Polska Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members globally in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. I agree to the processing of personal data provided in this document for realising the recruitment process pursuant to the Personal Data Protection Act of 10 May 2018 (Journal of Laws 2018, item 1000) and in agreement with Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation).