Senior Azure Data Engineer

technologies-expected :

- Azure Databricks
- Delta Lake
- Azure Data Factory
- Python
- PySpark
- SQL
- Azure DevOps
- GitHub
- Jenkins

technologies-optional :

- Hadoop
- Cloudera
- Prometheus

about-project :

- As a Senior Azure Data Engineer you will be working for our client, a global financial technology leader that provides infrastructure and services for capital markets, payments, and financial information management. You will be part of a high-impact cloud modernization program aimed at migrating legacy Cloudera and Hadoop-based data environments to a cutting-edge Azure ecosystem. This project focuses on rebuilding data architectures to enable scalable BI analytics, regulatory reporting, and metadata-driven automation across multiple geographies, while maintaining strict data governance and performance standards.
- Warsaw based opportunity with a hybrid work model - 2-3 day/week in the office.

responsibilities :

- Lead the migration of on-premises Cloudera and Hadoop data platforms to Azure Databricks
- Design and implement scalable ETL/ELT frameworks based on medallion architecture principles
- Develop metadata-driven data ingestion, transformation, and quality validation pipelines
- Automate deployment and orchestration using CI/CD pipelines and DevOps tools
- Collaborate with business and IT stakeholders to translate data requirements into robust technical solutions
- Optimize and refactor Spark and PySpark code to improve performance and cost efficiency
- Ensure data security, compliance, and governance across all data layers
- Mentor and guide data engineers in best practices for data lakehouse development
- Support end-to-end delivery from data ingestion to BI and API publication
- Drive innovation by identifying opportunities for automation and platform improvement

requirements-expected :

- Proven experience in large-scale data platform migration and modernization projects
- Deep expertise in Azure Databricks, Delta Lake, and Azure Data Factory
- Strong programming skills in Python, PySpark, and SQL
- Hands-on experience with CI/CD pipelines using Azure DevOps, GitHub, or Jenkins
- Solid understanding of medallion architecture and metadata-driven data engineering
- Familiarity with orchestration tools such as Airflow or Azure Data Factory
- Strong knowledge of data governance, lineage, and regulatory compliance frameworks
- Excellent analytical and problem-solving abilities in complex data environments
- Ability to collaborate effectively with cross-functional and business teams
- A degree in Computer Science, Engineering, or a related technical discipline

offered :

- Stable and long-term cooperation with very good conditions
- Enhance your skills and develop your expertise in the financial industry
- Work on the most strategic projects available in the market
- Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
- Participate in Social Events, training, and work in an international environment
- Access to attractive Medical Package
- Access to Multisport Program
- Access to Pluralsight
- Flexible hours

benefits :

- sharing the costs of sports activities
- private medical care
- flexible working time
- fruits
- integration events
- corporate gym
- mobile phone available for private use
- computer available for private use
- saving & investment scheme
- no dress code
- coffee / tea
- drinks
- christmas gifts
- birthday celebration
- access to +100 projects
- access to Pluralsight