Senior Data Engineer

Senior Data Engineer Miejsce pracy: Wrocław Technologies we use Expected Python SQL Power BI About the project - Type of project: Automotive - Office location: Wrocław - Work model: hybrid - Budget: 140 net/ hour - b2b - Project length: long-term - Only candidates with citizenship in the European Union and residence in Poland - Start date: ASAP (depending on candidate"s availability) Your responsibilities Designing, developing, and maintaining data pipelines using Azure Databricks and Delta Lake Implementing data applications in Python/PySpark for ingestion, historization, integration, and filtering Developing data quality frameworks, observability features, and monitoring tools Optimizing the performance and cost-efficiency of data workflows Our requirements At least 5 years of experiance in data engineering Proficiency in Databricks and Azure Data Factory (ADF) Solid knowledge of Python and SQL / MS SQL Familiarity with Power BI Understanding of DevOps practices Experience with CI/CD pipelines This is how we organize our work Team size 10 This is how we work at the client's site you focus on a single project at a time you develop several projects simultaneously you have influence on the technological solutions applied you focus on product development agile scrum This is how we work on a project Clean Code code review DevOps test automation testing environments Development opportunities we offer development budget intracompany training substantive support from technological leaders technical knowledge exchange within the company What we offer Hybrid working model Full-time job agreement based on b2b or employment contract Private medical care with dental care (covering 70% of costs) rehabilitation package. Family package option possible Multisport card (also for an accompanying person) Life insurance Benefits sharing the costs of sports activities private medical care sharing the costs of professional training & courses life insurance remote work opportunities flexible working time dental care no dress code Recruitment stages HR Screen Technical interview Project interview Cyclad In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking a highly experienced Senior Data Engineer to join a development team in the automotive industry. The ideal candidate will have at least 5 years of experience in data processing, preferably within an Azure cloud environment Please enclose the following statement in your application:I hereby give consent for my personal data contained in the submitted application documents to be processed by Cyclad sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, including my image, in relation to my participation in the recruitment process. I acknowledge that the above consent may be withdrawn at any time. If you are interested in participating in future recruitment processes, please enclose the following statement in your application:I hereby give consent for my personal data contained in the submitted application documents to be processed by Cyclad Sp. z o.o., Cyclad sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, including my image, in relation to my participation in future recruitment processes. I acknowledge that the above consent may be withdrawn at any time.The Personal Data Controller is Cyclad Sp. z o.o., ul. Chłodna 48/1, 00-872 Warszawa, e-mail: office@cyclad.pl, contact with the Data Protection Officer is available via e-mail: IOD@cyclad.pl. Personal data collected through job applications (CV) within the scope provided for in labor regulations shall be processed in order to allow performance of the ongoing recruitment pursuant to Art. 6(1)(a) of Regulation (EU) no. 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of individuals with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (further referred to as GDPR). In case of giving consent to processing of data for future recruitment processes – personal data shall be processed under theconsent, pursuant to Art. 6(1)(a) of the GDPR. If the Application form contains data referred to in Art. 9(1) of the GDPR, it shall be necessary to have the candidates consent for the processing of such data (Art. 9(2)(a) of the GDPR). The consent can be revoked at any time. Withdrawal of the consent shall not affectthe lawfulness of the processing that had been performed under the consent prior to its withdrawal. Personal data provided by the candidate related to:- participation in a selected recruitment process will be stored until the recruitment process is completed for a given position,- participation in future recruitment processes will be stored until the candidate's consent to the processing of their data for this purpose is withdrawn, no longer, however, than for 5 years since the last update of the candidate's data.Personal data may be disclosed to employees or associates of the Company, entities providing support to the Company on the basis of outsourced services or in accordance with data processing agreements, to entities authorized under the law, as well as to entities collaborating with the Company within the scope of job placement, in order to conduct recruitment processes. After the employee's consent, personal data may also be disclosed to a potential employer for whom the recruitment process is being conducted.Submission of the candidate's personal data within the scope under Art. 221 of the Labor Code is obligatory for participation in the recruitment process. Submission of other data by the candidate is voluntary. No submission of personal data within the required scope or objection to the processing ofsuch data shall result in lack of possibility to include the Application in the recruitment processes conducted by the Company.The candidate has the right to access and rectify the contents of their data, remove such data, limit its processing, transfer such data, submit objection to the processing and revoke the consent at any time, without affecting the lawfulness of the processing conducted under such consent before it waswithdrawn. The candidate also has the right to file a complaint with the President of the Office for Personal Data Protection when they consider the processing of their personal data to be a violation of the provisions of the GDPR.