Senior Data AWS Engineer
1 tydzień temu
For Digital Hub Warsaw, we are looking for: Senior Data AWS Engineer Participate in a global, strategic project in the Bayer Consumer Health division that will influence data in our business and manufacturing processes going forward. Our AWS-based data platform aggregates information from various sources to promote efficiency, creativity and better decision-making. To build scalable, high-performing and secure pipelines while working with teams around the world, we are seeking a hands-on Data Engineer. Contribute to a platform that will shape Bayer's digital future for Consumer Health division. Your Tasks & Responsibilities:Play a key role in driving the design and implementation of AWS Data Lake, including orchestration and security guardrailsDefine and enforce data architecture standards, including metadata, lineage and governanceBuild and optimize ETL/ELT pipelines using AWS Glue, Spark, Athena, Lake Formation, S3, Step Functions, LambdaCollaborate with DevSecOps engineers on infrastructure automation and CI/CD pipelines using tools such as GitHub Actions and TerraformAutomate deployment and management of data infrastructure and workflows to ensure reliability and scalabilityImplement and manage IAM policies, KMS encryption, VPC configurations and audit mechanisms to ensure security and complianceEnsure platform scalability, performance and cost efficiency (e.g., partitioning, catching strategies)Coordinate integration with AI/ML pipelines, including feature engineering and data validationParticipate in validation and documentation efforts aligned with GxPEngage with stakeholders (Product, PM, PO, Architects) to align technical design with business needsManage and reduce technical debt in data pipelines and infrastructureAct as technical lead and reviewer for offshore data engineers Qualifications & Competencies (education, skills, experience):· 5+ years of experience in data engineering on AWS· Strong knowledge of AWS data stack: Glue, Athena, Lake Formation, S3, Step Functions, Lambda, RDS etc.· Proficient in Python for scripting, automation and data manipulation tasks· Experience with PySpark for building scalable, distributed ETL/ELT pipelines using Apache Spark (especially within AWS Glue)· Experience designing enterprise data lakes and data mesh architecture· Experience in structuring and modelling data in both relational and non-relational forms· Ability to elaborate and propose relational/non-relational approach· Advanced knowledge of databases, including query optimization, relational and non-relational schema design· Expertise in data storage technologies, including files, relational databases, NoSQL and various data types (structured, unstructured, metrics, logs)· Deep understanding of data governance, lineage and metadata management· Experience in implementing data quality frameworks, validation checks and monitoring to ensure reliability of data· Hands-on experience with real-time data streaming technologies and patterns (e.g. Kinesis, Kafka, or similar) for event-driven architectures· Solid awareness of DevSecOps practices, including automation of CI/CD pipelines (GitHub Actions or similar), infrastructure as code (Terraform), IAM roles, encryption, SAST/SCA tools integration, auditability· Leadership and team coordination skills - ability to lead distributed teams· AWS Certified Data Engineer - Associate, additional certifications such as AWS Certified DevOps Engineer, AWS Certified Solutions Architect or AWS Certified Developer are a plus· Fluent in English (written and spoken) Nice to Haves:· Experience with AI/ML data pipelines, embedding management or feature stores· Knowledge of data quality frameworks· Hands-on experience configuring and developing dashboards in tools such as Power BI, Grafana or Tableau, including data source integration, metric definitions, and visual layer optimization· Experience in regulated environments (GxP, pharma, financial or healthcare)What do We offer: · A flexible, hybrid work model· Great workplace in a new modern office in Warsaw· Career development, 360° Feedback & Mentoring program· Wide access to professional development tools, training, & conferences· Company Bonus & Reward Structure· VIP Medical Care Package (including Dental & Mental health)· Holiday allowance (“Wczasy pod gruszą”)· Life & Travel Insurance· Pension plan· Co-financed sport card - FitProfit· Meals Subsidy in Office· Additional days off· Budget for Home Office Setup & Maintenance· Access to Company Game Room equipped with table tennis, soccer table, Sony PlayStation 5 and Xbox Series X consoles setup with premium game passes, and massage chairs· Tailored-made support in relocation to Warsaw when needed· Please send your CV in English You feel you do not meet all the criteria we are looking for? That doesn’t mean you aren’t the right fit for the role. Apply with confidence, we value potential over perfection WORK LOCATION: WARSAW AL. JEROZOLIMSKIE 158
-
Senior AWS BI Data Engineer
3 tygodni temu
Warszawa, mazowieckie, mazowieckie, Polska Be in IT Pełny etatSenior AWS BI Data EngineerMiejsce pracy: WarszawaTechnologie, których używamyWymaganeAWSPythonSQLAmazon QuickSightMicrosoft Power BITableauGitSystem operacyjnyWindowsLinuxO projekcieDługofalowa współpraca z międzynarodową, topową firmą consultingową, świadcząca usługi IT dla dużych i średnich firm z różnorodnych sektorów jak healthcare,...
-
Senior Data Engineer – Python Spark AWS
4 tygodni temu
Warszawa, mazowieckie, Polska Link Group Pełny etat 35 złSenior Data Engineer – Python, Spark, AWSWe’re looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating...
-
AWS Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat 25 zł - 200 złLocation: 100% remote (Poland) Start Date: ASAP / within 1 monthDescriptionWe are looking for an experienced AWS Data Engineer with a strong background in designing and implementing cloud-based data solutions. This role involves working on large-scale and unstructured datasets, optimizing data workflows, and collaborating with cross-functional teams to...
-
Data Engineer AWS Lakehouse
4 tygodni temu
Warszawa, mazowieckie, Polska 7N Pełny etat 2 zł - 940 złData Engineer (AWS / Lakehouse)Poszukujemy Mid/Senior Data Engineera.Dołączysz do projektu naszego klienta z branży finansowej / fintech w ramach Data Products Team. Opis projektu:Projekt dotyczy rozwoju i utrzymania infrastruktury danych w ramach komercyjnej platformy produktowej. Celem zespołu jest dostarczanie skalowalnych data models wykorzystywanych...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska 1dea Pełny etat 25 zł - 200 złSenior Data Engineer – AWS/Databricks/PythonPrimary Responsibilities:Design, develop and maintain data pipelines to extract data from a variety of sources and populate data lake and data warehouseDevelop the various data transformation rules and data modelling capabilitiesCollaborate with Product Analyst, Data Scientists, and Machine Learning Engineers to...
-
Senior Data Engineer with AWS and Snowflake
3 tygodni temu
Warszawa, mazowieckie, mazowieckie, Polska Sii Sp. z o.o. Pełny etatSenior Data Engineer with AWS and SnowflakeMiejsce pracy: WarszawaTechnologies we useExpectedSnowflakeData VaultPythonSQLAbout the projectWe are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support...
-
Senior Data Engineer with AWS and Snowflake
4 tygodni temu
Warszawa, mazowieckie, mazowieckie, Polska Sii Sp. z o.o. Pełny etatSenior Data Engineer with AWS and SnowflakeMiejsce pracy: WarszawaTechnologies we useExpectedSnowflakeData VaultPythonSQLAbout the projectWe are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support...
-
Senior Data Engineer AWS
1 tydzień temu
Warszawa, mazowieckie, Polska DS STREAM Pełny etat 25 zł - 200 złWe are looking for experienced Data Engineers to join our team at DS STREAM!You will be responsible for:Designing, implementing, and maintaining scalable data platforms and pipelines on AWS, including data warehouses, data lakes, and real-time streaming solutions that support the AI platform’s low-latency needs.Building and operating high-quality data...
-
AWS Data Engineer
1 tydzień temu
Warszawa, mazowieckie, mazowieckie, Polska Capgemini Polska Pełny etatAWS Data EngineerMiejsce pracy: WarszawaTechnologies we useOperating systemWindowsAbout the projectJoin our Insights & Data team, a community of over 400 professionals delivering impactful, data-driven solutions. We specialize in building scalable cloud-native data architectures and pipelines that power analytics and machine learning across various...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Bayer Sp. z o.o. Pełny etat 18 zł - 500 złAt Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where ,Health for all, Hunger for none’ is no longer a dream, but a real possibility. We’re doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our...