Senior Data Engineer Market Data Asset

Senior Data Engineer Market Data Asset Miejsce pracy: Warszawa Technologies we use Expected Python SQL PySpark Azure Data Lake Gen2 Azure Data Factory Databricks GitHub VCS GitHub Actions Azure DevOps Pipelines About the project The Data Assets, Analytics & AI organization at Bayer Consumer Health focuses on driving digital transformation and innovation by creating best-in-class analytical solutions that enable data-driven decision making and performance optimization for Bayer Consumer Health. You will be part of the Data Assets, Analytics & AI organization and will be responsible for building data assets. You partner with business stakeholders, data analysts, data architects, data scientists, analytics leads as well as other engineers. You will build data pipelines, data models and provision data for Analytics products and data scientists. You will also make sure that proper development processes are followed within the team, enhance implementation frameworks and guide other team members in building scalable, secure and well performing data products. If you are interested in joining a young and dynamic team driving the digital transformation of Bayer Consumer Health, we would like to hear from you. Your responsibilities Implement efficient data pipelines that integrate data from different sources and business domains to develop globally harmonized data models and KPI calculations Contribute to define data management and data quality standards. Ensure that data is well-managed to build stable, reusable and quality assured data assets. Collaborate with other IT functions (enabling functions data asset teams, analytics teams, platform product managers & integration architects) to ensure the aforementioned activities are executed effectively. Ensure that data products adhere to the data protection and compliance standards. Implement effective data access management policies, data privacy policies and secure data provisioning based on corporate guidelines. Continuously enhance implementation frameworks based on the needs of the analytics products consuming the data assets in your responsibility. Guide other data engineers in your team (internal or external engineers) and ensure that all engineers apply same design principles and assure code quality. Break down bigger work packages into manageable tasks. Together with the assigned data architect, ensure that cost and time estimations are accurate, quality of delivery is assured, and deliverables are properly tested, documented and handed over to the operations team. Our requirements Bachelor/Master's degree in Computer Science, Engineering, or a related field. 5 years of working experience in the field of Data & Analytics, preferably in the CPG industry 5 years of proficient coding experience with Python for data engineering, including SQL and PySpark (DataFrame API, Spark SQL, MLlib), with hands-on experience in various databases (SQL/NoSQL), key libraries (e.g., pandas, SQLAlchemy), parallel processing, and advanced data transformation and performance optimization techniques. Ability to develop, and maintain data engineering applications using Python classes and PySpark, ensuring code modularity, reusability, and maintainability. Excellent data engineering & technology knowledge (Azure Data Lake Gen2, Azure Data Factory and Databricks as well as data management knowhow (data cataloguing, data quality management) Solid understanding of data modeling, ETL processing and lakehouse concepts. Profound knowledge of CI/CD processes and tools (GitHub VCS, GitHub Actions, Azure DevOps Pipelines)) Profound data content knowledge of market data (Sell-out, Sell-through) for the CPG or health care industry which is licensable from data providers like IQVIA, Nielsen and IRI. Advanced understanding of data governance processes to support mapping of data from multiple sources. Experience in leading developer teams and breaking down work into smaller work packages, experience in Agile methodologies (Scrum, Kanban) in order to manage the work. Strong problem solving and analytical skills. Excellent interpersonal and communication skills, team collaboration, active listening, consulting, challenging in a constructive way. Fluent in English, both written & spoken, intercultural awareness and willingness to travel. This is how we organize our work This is how we work in house scrum kanban What we offer A flexible, hybrid work model Great workplace in a new modern office in Warsaw Career development, 360° Feedback & Mentoring programme Wide access to professional development tools, trainings, & conferences Company Bonus & Reward Structure VIP Medical Care Package (including Dental & Mental health) Holiday allowance ("Wczasy pod gruszą") Life & Travel Insurance Pension plan Co-financed sport card - FitProfit Meals Subsidy in Office Additional days off Budget for Home Office Setup & Maintenance Access to Company Game Room equipped with table tennis, soccer table, Sony PlayStation 5 and Xbox Series X consoles setup with premium game passes, and massage chairs Tailored-made support in relocation to Warsaw when needed Benefits sharing the costs of sports activities private medical care sharing the costs of foreign language classes sharing the costs of professional training & courses life insurance remote work opportunities flexible working time dental care retirement pension plan no dress code video games at work coffee / tea parking space for employees pre-paid cards employee referral program extra leave Bayer is an Equal Opportunity Employer. Bayer is committed to providing access and reasonable accommodations in its application process for individuals with disabilities and encourages applicants with disabilities to request any needed accommodation(s). Bayer is committed to providing access and reasonable accommodations in its application process for individuals with disabilities and encourages applicants with disabilities to request any needed accommodation(s) using the contact information below. We kindly inform that we will only contact selected candidates. Bayer welcomes applications from all individuals regardless of race, national origin, gender, age, physical characteristics, social origin, disabilities, union membership, religion, family status, pregnancy, sexual orientation, gender identity, gender expression, or any unlawful criterion under applicable law. We are committed to treating all applicants fairly and avoiding discrimination. Bayer is committed to providing access and reasonable accommodations in its application process for individuals with disabilities and encourages applicants with disabilities to request any needed accommodation(s) using the contact information below. Bayer offers the possibility of working in a hybrid model. We know how important work-life balance is, so our employees can work from home, from the office or combine both work environments. The possibilities of using the hybrid model are each time discussed with the manager. Please send your CV in English Digital Hub Warsaw at Bayer At the Heart of the Digital Hub Warsaw at Bayer lies the agile culture and mindset. Its philosophy and principles are in our DNA and drive the growth and the heartbeat of our organization in order to build and expand the DHub across all six functional divisions: Crop Science, Cyber Security & Risk Management, Consumer Health, Pharma, Enabling Functions and Enterprise Platforms & Innovation. To allow our organization to thrive and grow we embrace a culture of open leadership, people empowerment, people development, diversity and innovation. This approach create a place where creative and innovative minds from the fields of data-science, cyber security software engineering and more, can come together, collaborate, and achieve great things. Here in Warsaw, you can think freely without entrenched hierarchical structures, artificial guidelines and boundaries - mirroring the work culture of a dynamic start-up. Klikając w przycisk "Aplikuj" lub w inny sposób wysyłając zgłoszenie rekrutacyjne, zgadzasz się na przetwarzanie Twoich danych osobowych przez Bayer Sp. z o.o. z siedzibą w: Al. Jerozolimskie 158, 02-326 Warszawa (Pracodawca), jako administratora danych osobowych w celu przeprowadzenia rekrutacji na stanowisko wskazane w ogłoszeniu. Twoje dane osobowe będą przetwarzane w oparciu o następujące podstawy prawne: (a) aby podjąć działania na Twoje żądanie przed zawarciem umowy (np. informacje o oczekiwanym wynagrodzeniu i dostępności do rozpoczęcia pracy); (b) w oparciu o nasz prawnie uzasadniony interes (np. imię, nazwisko, data urodzenia, dane kontaktowe, wykształcenie, kwalifikacje zawodowe, przebieg dotychczasowego zatrudnienia); c) w oparciu o Twoją zgodę, która wyrażona jest poprzez przeslanie dokumentów aplikacyjnych zawierających takie informacje jak np. wizerunek czy zainteresowania.Podanie wszystkich danych osobowych, o których mowa powyżej jest dobrowolne, natomiast dane wymienione w lit. a) i b) są niezbędne do wzięcia udziału w rekrutacji. Niepodanie danych skutkuje brakiem możliwości rozpatrzenia kandydatury. Podanie pozostałych danych jest dobrowolne, ale może pomóc w sprawnym przeprowadzeniu procesu rekrutacji.Masz prawo żądać dostępu do Twoich danych (w tym uzyskania ich kopii), sprostowania danych, ich usunięcia, ograniczenia przetwarzania, przeniesienia, jak również wniesienia sprzeciwu wobec ich przetwarzania. Masz także prawo wniesienia skargi do Prezesa Urzędu Ochrony Danych Osobowych.Twoje dane osobowe mogą zostać przekazane dostawcom usługi publikacji ogłoszeń o pracę, dostawcom systemów do zarządzania rekrutacjami, dostawcom usług IT (hosting), dostawcom systemów informatycznych.Podane przez Ciebie dane osobowe nie będą wykorzystywane w celu profilowania albo podejmowania decyzji w sposób zautomatyzowany.Twoje dane osobowe będą przetwarzane przez okres maks. 1 roku od zakończenia publikacji ogłoszenia, chyba, że wyraziłeś odrębną zgodę na wykorzystanie Twoich danych osobowych w przyszłych rekrutacjach.W celu realizacji praw lub w przypadku jakichkolwiek pytań związanych z przetwarzaniem Twoich danych osobowych skontaktuj się z nami pod adresem: katarzyna.olejniczak.ext@bayer.com.