Big Data Architect Lead

4 dni temu


Kraków, Lesser Poland Addepto Pełny etat
Job Responsibilities

As a Senior Data Engineer, you will be responsible for designing and optimizing scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster. You will also architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability. Additionally, you will lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.

The ideal candidate will have a strong understanding of dimensional data and data modeling techniques. Experience with data governance and data management processes is also necessary. Furthermore, the ability to translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality is crucial for this role.

You will collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment. Designing and managing complex data transformations using Databricks, DBT, and Apache Airflow is also an essential part of this position.

  • Kraków, Lesser Poland Heineken Pełny etat

    About the RoleThe Data Foundation Team at Heineken is looking for a skilled Senior Data Engineer to lead the development of big data solutions. As a key member of our team, you will be responsible for mentoring junior engineers, ensuring adherence to coding standards, and driving operational excellence.Main Responsibilities:Mentor junior engineers in...

  • Data Architect Lead

    5 dni temu


    Kraków, Lesser Poland Pertemps ERP Pełny etat

    Job OverviewPertemps ERP seeks a seasoned Data Architect Lead to drive the development of effective cloud data models in Azure Datalake & Azure Databricks.This role requires a strong understanding of data warehouse structure principles and experience in architecting and modelling BI and Analytics solutions.


  • Kraków, Lesser Poland Luxoft Pełny etat

    Role Overview:We are seeking a highly experienced Big Data Engineering Lead to join our team and lead the development of our cloud-based data processing platform. As a key member of our team, you will be responsible for overseeing the design and implementation of efficient data pipelines using Azure technologies.The ideal candidate will have extensive...

  • Data Engineer Lead

    6 dni temu


    Kraków, Lesser Poland Addepto Pełny etat

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team at Addepto. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key ResponsibilitiesDesign and optimize scalable data processing pipelines using Big Data...

  • Lead Big Data Developer

    1 tydzień temu


    Kraków, Lesser Poland EPAM Systems (Poland) sp. z o.o. Pełny etat

    technologies-expected : Python Scala Java Spark Databricks Microsoft Azure AWS technologies-optional : Hadoop Spark Kafka Oozie Airflow HDFS YARN Solr OpenSearch Lucene about-project : We seek Lead Big Data Developers with cloud experience to join our growing Data Practice. The projects we are working on are diverse, covering all technologies and solutions...

  • Data Architect Lead

    3 dni temu


    Kraków, Lesser Poland Molecular Diversity Preservation International Pełny etat

    Job OverviewMolecular Diversity Preservation International seeks a seasoned data architect to lead our data engineering team and build the foundation of our data-driven success.This is a fully in-office role based in Kraków, where you will be at the forefront of designing, implementing, and maintaining our data infrastructure. You will lead a small team of...


  • Kraków, Lesser Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    Job OverviewExperis ManpowerGroup Sp. z o.o. seeks a Cloud-Based Data Analytics Expert to design, build, and manage scalable big data architectures and solutions.Key Responsibilities:Develop and optimize data pipelines for processing large-scale datasets, focusing on high-quality and timely delivery.Collaborate with cross-functional teams to integrate and...

  • Data Architect Lead

    5 dni temu


    Kraków, Lesser Poland Aon Hewitt Pełny etat

    About Aon HewittAon Hewitt is a global professional services firm that specializes in human capital consulting and outsourcing solutions. Our mission is to help organizations achieve their goals by providing expert advice on human capital management, talent development, and risk mitigation.As a leading provider of human capital consulting services, we have a...


  • Kraków, Lesser Poland TN Poland Pełny etat

    About TN PolandWe are a leading company in the data engineering space, and we're seeking an experienced Senior Data Architect to join our team. Our ideal candidate will have a strong background in designing and implementing effective cloud data models, as well as expertise in SQL and database management systems.Responsibilities:Design and implement cloud...

  • Big Data Specialist

    2 dni temu


    Kraków, Lesser Poland TN Poland Pełny etat

    Data Specialist Job DescriptionTN Poland is seeking a highly skilled Big Data Specialist to join our team. In this role, you will lead the design and implementation of large-scale data processing systems, providing strategic insights that drive business success.The ideal candidate will have a strong background in big data processing and cloud technologies,...

  • Lead Big Data Engineer

    8 godzin temu


    Kraków, Lesser Poland Luxoft Pełny etat

    4 days ago Be among the first 25 applicantsPrivate Medical & Dental care & Life Insurance coveredInternal Mobility program - possibility of rotation between projects, locations, accounts...and moreProject Description:The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large...


  • Kraków, Lesser Poland Promote Project Pełny etat

    **About the Role**We are seeking a highly skilled Big Data Engineer to join our team at Promote Project. The successful candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on cloud projects for large-scale data processing and analytics.As a key member of our data engineering squad, you will work...


  • Kraków, Lesser Poland Luxoft Pełny etat

    Job Description:We are seeking a highly skilled Data Architect to lead the development of our cloud-based data processing platform. As a key member of our team, you will be responsible for designing and implementing efficient data pipelines using Azure technologies.The ideal candidate will have extensive experience in building scalable data architectures,...

  • Big Data Specialist

    3 dni temu


    Kraków, Lesser Poland GlobalLogic Pełny etat

    **Benefits of Working at GlobalLogic**We offer a range of benefits to our employees, including comprehensive training programs, flexible work arrangements, and opportunities for career advancement.As a Big Data Specialist on our team, you will have the opportunity to work on challenging projects and develop your skills in big data technologies, cloud...

  • Big Data Engineer

    4 dni temu


    Kraków, Lesser Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    Responsibilities:Designing, building, and managing scalable big data architectures and solutionsDeveloping and optimizing data pipelines for processing large-scale datasetsIntegrating and processing data from various sources to enable analytics and reportingEnsuring the data infrastructure is robust, reliable, and efficientCollaborating with data scientists,...

  • Lead Big Data Engineer

    8 godzin temu


    Kraków, Lesser Poland Luxoft Poland Pełny etat

    The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data Lakehouse architecture to...


  • Kraków, Lesser Poland LoopMe Pełny etat

    Job Description:We are seeking a highly skilled Software Engineer with experience designing, building, and maintaining high-scale, big-data distributed systems. The successful candidate will collaborate on designing and setting up new features and system improvements, manage and optimize cloud infrastructure on Google Cloud Platform (GCP), lead efforts to...


  • Kraków, Lesser Poland Luxoft Pełny etat

    Luxoft is committed to delivering top performance to our customers. As a Senior Data Processing Expert, you will be responsible for designing and developing cutting-edge data processing solutions.Your Key ResponsibilitiesDevelop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.Build...

  • Senior Data Architect

    4 tygodni temu


    Kraków, Lesser Poland Pertemps ERP Pełny etat

    Job Type: Full-TimeLocation: Working remotely - europeStart Date: January 2025End Date: 1 yearTasks- Design and implement effective cloud data models in Azure Datalake & Azure Databricks to store and retrieve company data.- Ensure data quality and integrity across data models- Develop and enforce development standards.- Architect and model Business...

  • Data Architect

    4 dni temu


    Kraków, Lesser Poland Luxoft Poland Pełny etat

    Company OverviewLuxoft Poland is a leading provider of software development and consulting services, with expertise in cloud-based data processing platforms. Our team focuses on building efficient management and real-time analysis of large datasets.Job DescriptionWe're looking for a Big Data Lead Engineer to engineer reliable data pipelines, transform data...