Senior Data AWS Engineer
4 dni temu
For Digital Hub Warsaw, we are looking for: Senior Data AWS Engineer Participate in a global, strategic project in the Bayer Consumer Health division that will influence data in our business and manufacturing processes going forward. Our AWS-based data platform aggregates information from various sources to promote efficiency, creativity and better decision-making. To build scalable, high-performing and secure pipelines while working with teams around the world, we are seeking a hands-on Data Engineer. Contribute to a platform that will shape Bayer's digital future for Consumer Health division. Your Tasks & Responsibilities: Play a key role in driving the design and implementation of AWS Data Lake, including orchestration and security guardrails Define and enforce data architecture standards, including metadata, lineage and governance Build and optimize ETL/ELT pipelines using AWS Glue, Spark, Athena, Lake Formation, S3, Step Functions, Lambda Collaborate with DevSecOps engineers on infrastructure automation and CI/CD pipelines using tools such as GitHub Actions and Terraform Automate deployment and management of data infrastructure and workflows to ensure reliability and scalability Implement and manage IAM policies, KMS encryption, VPC configurations and audit mechanisms to ensure security and compliance Ensure platform scalability, performance and cost efficiency (e.g., partitioning, catching strategies) Coordinate integration with AI/ML pipelines, including feature engineering and data validation Participate in validation and documentation efforts aligned with GxP Engage with stakeholders (Product, PM, PO, Architects) to align technical design with business needs Manage and reduce technical debt in data pipelines and infrastructure Act as technical lead and reviewer for offshore data engineers Qualifications & Competencies (education, skills, experience): · 5 years of experience in data engineering on AWS · Strong knowledge of AWS data stack: Glue, Athena, Lake Formation, S3, Step Functions, Lambda, RDS etc. · Proficient in Python for scripting, automation and data manipulation tasks · Experience with PySpark for building scalable, distributed ETL/ELT pipelines using Apache Spark (especially within AWS Glue) · Experience designing enterprise data lakes and data mesh architecture · Experience in structuring and modelling data in both relational and non-relational forms · Ability to elaborate and propose relational/non-relational approach · Advanced knowledge of databases, including query optimization, relational and non-relational schema design · Expertise in data storage technologies, including files, relational databases, NoSQL and various data types (structured, unstructured, metrics, logs) · Deep understanding of data governance, lineage and metadata management · Experience in implementing data quality frameworks, validation checks and monitoring to ensure reliability of data · Hands-on experience with real-time data streaming technologies and patterns (e.g. Kinesis, Kafka, or similar) for event-driven architectures · Solid awareness of DevSecOps practices, including automation of CI/CD pipelines (GitHub Actions or similar), infrastructure as code (Terraform), IAM roles, encryption, SAST/SCA tools integration, auditability · Leadership and team coordination skills - ability to lead distributed teams · AWS Certified Data Engineer - Associate, additional certifications such as AWS Certified DevOps Engineer, AWS Certified Solutions Architect or AWS Certified Developer are a plus · Fluent in English (written and spoken) Nice to Haves: · Experience with AI/ML data pipelines, embedding management or feature stores · Knowledge of data quality frameworks · Hands-on experience configuring and developing dashboards in tools such as Power BI, Grafana or Tableau, including data source integration, metric definitions, and visual layer optimization · Experience in regulated environments (GxP, pharma, financial or healthcare) What do We offer: · A flexible, hybrid work model · Great workplace in a new modern office in Warsaw · Career development, 360° Feedback & Mentoring program · Wide access to professional development tools, training, & conferences · Company Bonus & Reward Structure · VIP Medical Care Package (including Dental & Mental health) · Holiday allowance ("Wczasy pod gruszą") · Life & Travel Insurance · Pension plan · Co-financed sport card - FitProfit · Meals Subsidy in Office · Additional days off · Budget for Home Office Setup & Maintenance · Access to Company Game Room equipped with table tennis, soccer table, Sony PlayStation 5 and Xbox Series X consoles setup with premium game passes, and massage chairs · Tailored-made support in relocation to Warsaw when needed · Please send your CV in English You feel you do not meet all the criteria we are looking for? That doesn't mean you aren't the right fit for the role. Apply with confidence, we value potential over perfection WORK LOCATION: WARSAW AL. JEROZOLIMSKIE 158
-
Senior AWS BI Data Engineer
3 tygodni temu
Warsaw, Polska Be in IT Pełny etatSenior AWS BI Data Engineer Miejsce pracy: Warszawa Technologie, których używamy Wymagane AWS Python SQL Amazon QuickSight Microsoft Power BI Tableau Git System operacyjny Windows Linux O projekcie Długofalowa współpraca z międzynarodową, topową firmą consultingową, świadcząca usługi IT dla dużych i średnich firm z różnorodnych sektorów jak...
-
Senior Data Engineer – Python Spark AWS
4 dni temu
Warsaw, Polska Link Group Pełny etatSenior Data Engineer – Python, Spark, AWS We're looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating...
-
Senior AWS Data Engineer
2 tygodni temu
Warsaw, Polska Cyclad Pełny etatSenior AWS Data Engineer Miejsce pracy: Warszawa Technologies we use Expected - Glue - Redshift - Lambda - Athena - S3 - Snowflake - Docker - Terraform - CloudFormation - Kafka - Airflow - Spark - Python - Scala - Java - Bash - AWS Optional - Airflow - Prefect - Kafka - Spark Streaming - Snowflake - Databricks About the project In Cyclad we work wih top...
-
Senior AWS Data Engineer
2 tygodni temu
Warsaw, Polska Cyclad Pełny etatSenior AWS Data Engineer Miejsce pracy: Warszawa Technologies we use Expected Glue Redshift Lambda Athena S3 Snowflake Docker Terraform CloudFormation Kafka Airflow Spark Python Scala Java Bash AWS Optional Airflow Prefect Kafka Spark Streaming Snowflake Databricks About the project In Cyclad we work wih top international IT companies in order to boost their...
-
Senior AWS Data Engineer
2 tygodni temu
Warsaw, Polska Cyclad Pełny etattechnologies-expected : - Glue - Redshift - Lambda - Athena - S3 - Snowflake - Docker - Terraform - CloudFormation - Kafka - Airflow - Spark - Python - Scala - Java - Bash - AWS technologies-optional : - Airflow - Prefect - Kafka - Spark Streaming - Snowflake - Databricks about-project : - In Cyclad we work wih top international IT companies in order to...
-
AWS Data Engineer
3 tygodni temu
Warsaw, Polska Experis Manpower Group Pełny etatLocation: 100% remote (Poland) Start Date : ASAP / within 1 month Description We are looking for an experienced AWS Data Engineer with a strong background in designing and implementing cloud-based data solutions. This role involves working on large-scale and unstructured datasets, optimizing data workflows, and collaborating with cross-functional teams to...
-
AWS Data Engineer
4 tygodni temu
Warsaw, Polska Capgemini Polska Pełny etatAWS Data Engineer Miejsce pracy: Warszawa Technologies we use Operating system Windows About the project Join our Insights & Data team, a community of over 400 professionals delivering impactful, data-driven solutions. We specialize in building scalable cloud-native data architectures and pipelines that power analytics and machine learning across various...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska Insightify Pełny etatWe are seeking a highly skilled and experienced Senior Data Engineer with solid expertise in AWS, Azure & GCP, along with proficiency in modern data transformation tools such as dbt and Databricks. Tasks In the role of Senior Data Engineer, you will be entrusted with the task of conceptualizing and implementing scalable and secure cloud-based data...
-
Senior AWS Platform Engineer Elasticsearch
1 tydzień temu
Warsaw, Polska emagine Polska Pełny etatInformation about the project: Industry: Pharma Location: Fully remote Rate: up to 180 pln/h net VAT, B2B Summary: The role is designed for a seasoned Senior AWS Platform Engineer who will play a crucial part in the global identity and access management team at a leading European pharmaceutical company. The primary goal is to work independently while...
-
Senior Data Engineer with AWS and Snowflake
1 tydzień temu
Warsaw, Polska Sii Sp. z o.o. Pełny etatSenior Data Engineer with AWS and Snowflake Miejsce pracy: Warszawa Technologies we use Expected Snowflake Data Vault Python SQL About the project We are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that...