Lead/ Senior GCP Data Engineer with Airflow
1 tydzień temu
You will be:
- developing and maintaining data pipelines to ensure seamless data flow from the Loyalty system to the data lake and data warehouse,
- collaborating with data engineers to ensure data engineering best practices are integrated into the development process,
- ensuring data integrity, consistency, and availability across all data systems,
- integrating data from various sources, including transactional databases, third-party APIs, and external data sources, into the data lake,
- implementing ETL processes to transform and load data into the data warehouse for analytics and reporting,
- working closely with cross-functional teams including Engineering, Business Analytics, Data Science and Product Management to understand data requirements and deliver solutions,
- collaborating with data engineers to ensure data engineering best practices are integrated into the development process,
- optimizing data storage and retrieval to improve performance and scalability,
- monitoring and troubleshooting data pipelines to ensure high reliability and efficiency,
- implementing and enforcing data governance policies to ensure data security, privacy, and compliance,
- developing documentation and standards for data processes and procedures.
Your profile:
- 7+ years in a data engineering role, with hands-on experience in building data processing pipelines,
- experience in leading the design and implementing of data pipelines and data products,
- proficiency with GCP services, for large-scale data processing and optimization,
- extensive experience with Apache Airflow, including DAG creation, triggers, and workflow optimization,
- knowledge of data partitioning, batch configuration, and performance tuning for terabyte-scale processing,
- strong Python proficiency, with expertise in modern data libraries and frameworks (e.g., Databricks, Snowflake, Spark, SQL),
- hands-on experience with ETL tools and processes,
- practical experience with dbt for data transformation,
- deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts,
- excellent command of oral and written English,
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
Nice to have:
- experience with ecommerce systems and their data integration,
- knowledge of data visualization tools (e.g., Tableau, Looker),
- understanding of machine learning and data analytics,
- certification in cloud platforms (AWS Certified Data Analytics, Google Professional Data Engineer, etc.).
Work from the European Union region and a work permit are required.
Recruitment Process: CV review – HR call – Technical Interview – Client Interview – Decision
Benefits
Development:
- development budgets of up to 6,800 PLN,
- we fund certifications e.g.: AWS, Azure, ISTQB, PSM,
- access to Udemyand O'Reilly (formerly Safari Books Online),
- events and technology conferences,
- technology Guilds,
- internal training,
- Xebia Upskill.
We take care of your health:
- private medical healthcare,
- multiSport card - we subsidise a MultiSport card,
- mental Health Support.
We are flexible:
- flexible working hours,
- B2B or permanent contract,
- contract for an indefinite period.
-
Lead Senior GCP Data Engineer with Airflow
3 tygodni temu
Gdańsk, Polska Xebia sp. z o.o. Pełny etatYou will be:developing and maintaining data pipelines to ensure seamless data flow from the Loyalty system to the data lake and data warehouse,collaborating with data engineers to ensure data engineering best practices are integrated into the development process,ensuring data integrity, consistency, and availability across all data systems,integrating data...
-
Senior Software Engineer Data Services
1 dzień temu
Gdańsk, Pomerania, Polska EPAM Systems Pełny etatWe are seeking a talented Senior Data Software Engineer to lead our team in designing and implementing data infrastructure solutions.Key ResponsibilitiesThe Senior Data Software Engineer will be responsible for:Providing technical leadership and guidance to junior engineers.Designing and building ETL/ELT pipelines using Airflow and other technologies on the...
-
Data Infrastructure Developer
1 dzień temu
Gdańsk, Pomerania, Polska EPAM Systems Pełny etatWe are looking for a highly skilled Senior Data Software Engineer to join our team in creating network infrastructure for high-speed internet access using fiber optic communication.About the RoleThis Senior Data Software Engineer position requires a strong background in software development, data engineering, and cloud computing.Develop and implement ETL/ELT...
-
Senior GCP Data Architect for Scalable Solutions
24 godzin temu
Gdańsk, Pomerania, Polska Xebia sp. z o.o. Pełny etatXebia sp. z o.o. is a technology-driven company with a mission to become the authority in its field of expertise.We offer a unique work environment where experts can grow and develop their skills, working on global, innovative projects with renowned brands such as UPS, McLaren, Aviva, Deloitte, and many more.The role of a Senior Data Engineer...
-
Cloud Data Engineer with Airflow Expertise
1 dzień temu
Gdańsk, Pomerania, Polska Xebia sp. z o.o. Pełny etatXebia sp. z o.o. is a leading provider of digital solutions, working with clients across various industries and regions worldwide.We have partnerships with top cloud providers, including AWS, Microsoft Azure, and Google Cloud Platform (GCP), showcasing our expertise in cloud-based solutions.As a Senior Data Engineer at Xebia, you will collaborate with...
-
Data Engineering Lead with Apache Airflow Experience
19 godzin temu
Gdańsk, Pomerania, Polska Xebia sp. z o.o. Pełny etatXebia sp. z o.o. is committed to providing a supportive and collaborative work environment that fosters growth and development.We believe in investing in our team members' potential and provide opportunities for training, mentorship, and career advancement.The role of a Senior Data Engineer requires:Experience with cloud-based solutions, particularly Google...
-
Senior Data Software Engineer
1 dzień temu
Gdańsk, Pomerania, Polska EPAM Systems Pełny etatSenior Data Software Engineer (Python, GCP)We are looking for a Senior Data Software Engineer to join the project in the telecommunications sector, focused on creating network infrastructure for high-speed internet access using fiber optic communication.In this role, you will work with an American multinational technology company. The project offers many...
-
Software Engineering Team Lead
1 dzień temu
Gdańsk, Pomerania, Polska EPAM Systems Pełny etatWe are seeking a Senior Data Software Engineer to join our team in the telecommunications sector. This position offers many opportunities to learn as our client is considered one of the Big Five companies in the American information technology industry.Job DescriptionThe Senior Data Software Engineer will be responsible for providing technical leadership and...
-
Cloud Computing Technical Specialist
1 dzień temu
Gdańsk, Pomerania, Polska EPAM Systems Pełny etatWe are looking for a Senior Data Software Engineer to join our team in developing and implementing data analytics solutions using Google Cloud Platform (GCP).About the JobThis role involves working closely with cross-functional teams to design, develop, and deploy data analytics solutions that meet the needs of our clients.Develop and implement ETL/ELT...
-
Technical Lead Data Engineer
2 dni temu
Gdańsk, Pomerania, Polska N-iX Pełny etat#2328Our Client is a global investment advisor organization that utilizes advanced technologies and data analytics to improve the operational performance of their portfolio companies. Key objectives include delivering strong financial returns, offering diverse investment opportunities, enhancing portfolio company operations, and proactively managing risks....
-
Big Data Engineer
5 dni temu
Gdańsk, Pomerania, Polska Addepto Pełny etatTransforming Business with AI and Big DataAt Addepto, we specialize in helping clients achieve innovative data projects through our expertise in AI and Big Data. Our team of technology experts partners with top-tier global enterprises and pioneering startups to deliver scalable data processing pipelines using cutting-edge technologies such as Databricks,...
-
Middle Senior Data Engineer
3 tygodni temu
Gdańsk, Polska Link Group Pełny etatData Engineer (Azure & Databricks)Responsibilities:Manage data pipelines and optimize query performance.Develop and maintain Azure Pipelines and Databricks jobs.Collaborate with senior stakeholders to define and improve solutions.Build robust data pipelines using DBT and implement performance optimizations.Requirements:4+ years of experience in database...
-
Senior GCP Data Engineer @
4 tygodni temu
Gdańsk, Pomerania, Polska Capgemini Polska Sp. z o.o. Pełny etatChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Senior Engineering Manager
5 dni temu
Gdańsk, Pomerania, Polska Addepto Pełny etatLeverage Your Expertise in Big DataAre you an experienced Senior Data Engineer looking for a new challenge? Do you have a passion for designing and developing scalable data processing pipelines using cutting-edge technologies such as Databricks, Apache Airflow, and Dagster?**Job Summary:**We are seeking a Senior Data Engineer to join our team at Addepto and...
-
Senior Data Engineer
1 tydzień temu
Gdańsk, Polska GreenMinds Sp. z o.o. Pełny etatAre you passionate about data and eager to design and implement cutting-edge data solutions? Join our dynamic team as a Senior Data Engineer and help us build scalable, secure, and high-performance data infrastructure Work Type: B2B Contract Language Requirement: Polish Key Responsibilities: Data Architecture & DesignDesign and implement scalable, secure,...
-
Senior Data Engineer
1 tydzień temu
Gdańsk, Pomerania, Polska GreenMinds Sp. z o.o. Pełny etatAre you passionate about data and eager to design and implement cutting-edge data solutions? Join our dynamic team as a Senior Data Engineer and help us build scalable, secure, and high-performance data infrastructure Work Type: B2B Contract Language Requirement: PolishFluency in Polish is a mandatory requirement. Key Responsibilities: Data Architecture &...
-
Senior Data Engineer
5 dni temu
Gdańsk, Polska GreenMinds Sp. z o.o. Pełny etatAre you passionate about data and eager to design and implement cutting-edge data solutions? Join our dynamic team as a Senior Data Engineer and help us build scalable, secure, and high-performance data infrastructure Work Type: B2B Contract Language Requirement: PolishFluency in Polish is a mandatory requirement. Key Responsibilities: Data Architecture &...
-
Data Engineer Position
2 dni temu
Gdańsk, Pomerania, Polska Arche Consulting Sp z o.o. Pełny etatJob DescriptionAs a Senior Data Pipeline Specialist at Arche Consulting Sp z o.o., you will be responsible for designing and implementing scalable data pipelines using Apache Spark and Python. Your task will be to develop and maintain data warehousing solutions with Apache Hive, orchestrate data workflows using Apache Airflow, manage and query SQL Server...
-
Gdańsk, Pomerania, Polska Xebia Pełny etatJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at Xebia. As a senior member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines using Google Cloud Platform (GCP) services.Responsibilities:Develop and maintain complex data pipelines to ensure seamless data flow from...
-
Gdańsk, Pomerania, Polska Xebia Pełny etatTechnical Requirements:To be successful in this role, you will need to have the following technical skills and qualifications:Key Skills:Proficiency with GCP services, including Apache Airflow, Databricks, Snowflake, Spark, SQL, and dbt.Experience with ETL tools and processes.Knowledge of data partitioning, batch configuration, and performance tuning for...