Praca dla cdc development w Wroclaw

You will be: designing and implementing scalable data pipelines ingesting data from DynamoDB, Aurora PostgreSQL, and Neptune, building and maintaining data lake layers, including Raw, Canonical, and Curated zones on Amazon S3 using Apache Iceberg, developing ingestion frameworks supporting both CDC and batch processing patterns, contributing to the...

Your profile - 5+ years of Data Engineering experience. - Strong PySpark, Python and SQL skills. - Hands-on experience with Azure Databricks and Delta Lake. - Experience delivering end-to-end data platforms and ingesting data from enterprise systems and APIs. - Knowledge of Auto Loader, CDC, SCD2, data quality and governance practices. - Experience with...