Senior Data Engineer
4 tygodni temu
At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where ,Health for all, Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our capabilities and redefining 'impossible'. There are so many reasons to join us. If you're hungry to build a varied and meaningful career in a community of brilliant and diverse minds to make a real difference, there's only one choice. Senior Data Engineer As a Senior Data Engineer, you will be a part of Bayer's Pharma Data & AI Team with varying assignments according to project needs. You will develop and operate robust, observable, and cost-efficient data pipelines and services powering analytics and data products on our Commercial Data Platform. YOUR TASKS AND RESPONSIBILITIES Collaborate closely within the data product team members, data source owners and data consumers (e.g. data scientists, data analysts) to understand data requirements and clarify acceptance criteria. Contribute to the design of analytical and domain data models that support the organization's data & analytics requirements now and in the future. Design, develop, and maintain scalable data pipelines for ingesting, transforming, and storing large volumes of data from diverse sources. Build and operate data solutions on AWS and in Snowflake or Databricks, applying modern lakehouse formats (Delta/Iceberg) where appropriate. Follow documented standards and industry best practices for data engineering, ensuring compliance with regulations and data governance policies. Embed automated data quality checks and validation gates within pipelines and CI/CD. Optimize data processing to improve performance and cost across storage and compute. Troubleshoot and resolve data-related incidents, ensuring minimal downtime and disruption to business operations. Lead root-cause analysis and drive blameless postmortems to reduce MTTR and prevent recurrences. Contribute to the data engineering community, defining & documenting data infrastructure, processes, and best practices for knowledge sharing and future reference. Participate in "data engineer on duty" rotations during regular office hours to support data services and incident response. Mentor junior engineers and uphold high standards in code review, testing, and documentation. WHO YOU ARE Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field. 5 years of experience in data engineering, data operations, or a similar role, delivering production-grade data pipelines and services. Familiarity with data product lifecycle management across disciplines: Demonstrated expertise designing, implementing, and operating robust data ingestion, transformation, and serving pipelines across batch and streaming architectures, leveraging expert knowledge in SQL and Python, and experience in orchestration via modern platforms such as Dagster or Airflow with sound workflow/dependency design. Experience with at least one major cloud service provider (AWS, Azure, or GCP), demonstrating the ability to leverage cloud technologies for business solutions. Good experience in building and maintaining streaming integrations with Kafka and/or Kinesis, ensuring exactly-once or idempotent processing, managing schema evolution, and implementing efficient replay strategies for reliable near-real-time data delivery. Good hands-on experience in leveraging solutions such as dbt Core to implement modular, tested, and well-documented data and analytics models; enforcing best practices for code quality, testing standards, and documentation throughout the data engineering lifecycle. Good experience with data quality frameworks (e.g. dbt tests, Great Expectations, PyTest), integrating comprehensive data validation and quality gates within CI/CD pipelines, and supporting incident triage and root cause analysis. Basic knowledge working with containerized solutions. Hands-on experience working with APIs such (GraphQL, OData, REST). Competent in usage of data integration and ingestion solutions (e.g. AWS API Gateway, dltHub, AWS AppFlow). Basic experience with modern lakehouse table formats (Apache Iceberg, Delta Lake) Good experience with cost and performance optimization and FinOps practices for cloud data systems such as Snowflake or Databricks, ensuring reliable operations and scalable data delivery in production environments. Strong ownership of deliverables, high standards for code review and peer mentorship, and a commitment to clear documentation, metadata/lineage publishing, and sustainable engineering practices. Good experience with agile development methodologies and tooling such as Azure DevOps Excellent analytical and problem-solving skills. Good communication and collaboration abilities. Ability to work independently and as part of a team. Strong adaptability and willingness to quickly learn and adopt new technologies and approaches in a dynamic, evolving data platform and business environment. WHAT DO WE OFFER: A flexible, hybrid work model Great workplace in a new modern office in Warsaw Career development, 360° Feedback & Mentoring programme Wide access to professional development tools, trainings, & conferences Company Bonus & Reward Structure Increased tax-deductible costs for authors of copyrighted works VIP Medical Care Package (including Dental & Mental health) Life & Travel Insurance Pension plan Co-financed sport card - FitProfit Meals Subsidy in Office Budget for Home Office Setup & Maintenance Access to Company Game Room equipped with table tennis, soccer table, Sony PlayStation 5 and Xbox Series X consoles setup with premium game passes, and massage chairs Tailored-made support in relocation to Warsaw when needed Please send your CV in English
-
Senior Data Engineer
1 tydzień temu
Warsaw, Polska Insightify Pełny etatWe are seeking a highly skilled and experienced Senior Data Engineer with solid expertise in AWS, Azure & GCP, along with proficiency in modern data transformation tools such as dbt and Databricks. Tasks In the role of Senior Data Engineer, you will be entrusted with the task of conceptualizing and implementing scalable and secure cloud-based data...
-
Senior Azure Data Engineer
1 tydzień temu
Warsaw, Polska Experis Manpower Group Pełny etatExperis to światowy lider rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz ciekawe projekty IT skierowane zarówno do ekspertów z wieloletnim doświadczeniem, jak i osób, które dopiero zaczynają swoją przygodę w branży IT. Senior Azure Data Engineer – Hybrid...
-
Senior Data Engineer Python Django
2 tygodni temu
Warsaw, Polska P&P Solutions Pełny etatOur client from the insurance industry is developing an advanced dashboard that presents key risk metrics for investors as well as performance indicators for the investment portfolio. The tool includes complex visualizations and reports that are frequently reviewed by senior leadership. As a Senior Data Engineer, you will be responsible for maintaining and...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska emagine Polska Pełny etatRate: B2B – 37-42 EUR/h. Work model: fully remote. Project length: 12 months extensions. Start date for assignment: ASAP/ 1 month. Project language: English, Polish. Industry: pharmaceutical. Recruitment process : 2 interviews with the client. Workload: Full time. Job Description Are you passionate about data engineering and developing data products that...
-
Senior Software Engineer
2 tygodni temu
Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etatSenior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected Java Typescript Pulumi Terraform Optional Trino Operating system macOS About the project As a Senior Software Engineer on the fully distributed Starburst Galaxy Reliability, Scalability, & Efficiency team, you'll own the reliability, scalability and efficiency (performance/$) of...
-
Senior Software Engineer
2 tygodni temu
Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etatSenior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected - Java - Typescript - Pulumi - Terraform Optional - Trino Operating system - macOS About the project As a Senior Software Engineer on the fully distributed Starburst Galaxy Reliability, Scalability, & Efficiency team, you’ll own the reliability, scalability and...
-
Senior Software Engineer
3 tygodni temu
Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etatSenior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected Java Operating system Windows About the project Starburst is looking for strong Java engineers to work with our globally distributed engineering team on the core of Starburst's software. This is a great opportunity to deepen your expertise in a rapidly evolving technology and make...
-
Senior Data Engineer
4 dni temu
Warsaw, Polska Procter & Gamble Pełny etatJob Description The Senior Data Engineer is responsible for designing, developing, and implementing data and analytics Microsoft Azure Databricks Platform and pipelines that acquire, cleanse, transform, and publish data from a wide variety of sources. Key Responsibilities: Assemble large complex data sets which meet functional and non-functional business...
-
Senior Data Engineer
3 tygodni temu
Warsaw, Polska Polski Standard Płatności S.A. Pełny etatSenior Data Engineer Miejsce pracy: Warszawa Technologie, których używamy Wymagane Python O projekcie Szukamy samodzielnych seniorów, którzy chcą mieć realny wpływ, a nie tylko "dowodzić tickety". Pracujemy w modelu "wolno, drogo, ale dobrze". Budujemy platformę danych od zera, kształtujemy kulturę data-driven w całej organizacji i decydujemy,...
-
Senior Software Engineer
4 tygodni temu
Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etatSenior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected Java TypeScript Pulumi Terraform Optional Trino Operating system Windows About the project As a Senior Software Engineer on the fully distributed Starburst Galaxy Reliability, Scalability, & Efficiency team, you'll own the reliability, scalability and efficiency (performance/$) of...