Big Data Architect

1 tydzień temu

Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat
Job Description

We are seeking a highly skilled Data Engineer to join our team at Addepto. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining large-scale data processing systems for various industries.

Main Responsibilities:

  • Develop and maintain high-performance data processing platforms for automotive data, ensuring scalability and reliability.
  • Design and implement data pipelines that process large volumes of data in both streaming and batch modes.
  • Optimize data workflows to ensure efficient data ingestion, processing, and storage using technologies such as Spark, Cloudera, and Airflow.
  • Work with data lake technologies (e.g., Iceberg) to manage structured and unstructured data efficiently.
  • Collaborate with cross-functional teams to understand data requirements and ensure seamless integration of data sources.
  • Monitor and troubleshoot the platform, ensuring high availability, performance, and accuracy of data processing.
  • Leverage cloud services (AWS) for infrastructure management and scaling of processing workloads.
  • Write and maintain high-quality Python (or Java/Scala) code for data processing tasks and automation.

Requirements:

  • At least 4 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.
  • Strong programming skills in Python (or Java/Scala): writing clean code, OOP design.
  • Hands-on with Big Data technologies like Spark, Cloudera, Data Platform, Airflow, NiFi, Docker, Kubernetes, Iceberg, Trino or Hudi.
  • Excellent understanding of dimensional data and data modeling techniques.
  • Experience implementing and deploying solutions in cloud environments.
  • Consulting experience with excellent communication and client management skills, including prior experience directly interacting with clients as a consultant.
  • Ability to work independently and take ownership of project deliverables.
  • Fluent English (at least C1 level).
  • Bachelor's degree in technical or mathematical studies.

  • Big Data Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska TN Poland Pełny etat

    About UsWe are TN Poland, a leading IT company that specializes in delivering innovative data-driven solutions. As a Big Data Architect, you will play a crucial role in shaping our data strategy and driving business growth.Main duties include:Designing and implementing scalable data architecturesDeveloping and maintaining high-performance data...

  • Big Data Architect

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    As a Cloud-Based Data Engineering Expert at Addepto, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Our goal is to build data platforms that are scalable, efficient, and reliable.Responsibilities:Design and optimize scalable data...

  • Big Data Architect

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska TN Poland Pełny etat

    We're seeking a Big Data Architect to join our team at TN Poland. As part of our digital transformation journey, you'll play a crucial role in shaping our cloud strategy and building innovative data pipelines in Azure Data Factory and Databricks. Your expertise will be essential in enabling new, data-driven services and driving business value through digital...

  • Big Data Solutions Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etat

    About the Team: We are a dynamic and inclusive team of professionals who share a passion for innovation and excellence. As a Big Data Solutions Architect, you will have the opportunity to work with a diverse team of experts and contribute to cutting-edge projects that deliver exceptional value to our customers.Responsibilities:Solution Design: Design and...

  • Big Data Processing Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Kdr HR Pełny etat

    Kdr HR is seeking a talented Big Data Processing Architect to lead our big data processing efforts. As a key member of our team, you will be responsible for designing and implementing large-scale data processing systems on Azure.About the RoleDevelop and implement advanced data analytics and machine learning models using PySpark and Azure...

  • Big Data Infrastructure Architect

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects.We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10...

  • Big Data Solutions Architect Lead

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    Job OverviewLuxoft is looking for an experienced Big Data Solutions Architect Lead to join our team. The successful candidate will have a deep understanding of cloud-based data processing platforms and the ability to lead the development of complex data systems.The ideal candidate will have experience in designing and implementing data pipelines, optimizing...

  • Big Data Solutions Architect

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    Job OverviewLuxoft is seeking a highly skilled and experienced Big Data Solutions Architect to lead the development of cutting-edge data processing platforms. As a key member of our team, you will be responsible for designing and implementing scalable and secure data architectures using cloud-based technologies.Key ResponsibilitiesData Pipeline Development:...

  • Big Data Technical Expert

    7 dni temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    **Job Description**As a Senior Data Engineer at Addepto, your responsibilities will include designing and optimizing scalable data processing pipelines for streaming and batch workloads using Big Data technologies. You will also architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.Additionally, you will...

  • Big Data Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    The RoleWe are looking for a seasoned Data Engineer with hands-on experience in using Python, Spark, AWS Cloud usage and management, Databricks, ML models and frameworks, orchestrators, containerization, and orchestration technologies.As a Data Engineer, you will be responsible for at-scale infrastructure design, build, and deployment with a focus on...

  • Big Data Systems Architect

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    **Job Description**We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Big Data Solutions group, you will be responsible for designing and implementing scalable data processing pipelines, architecting end-to-end data platforms, and collaborating with Data Science teams on Machine Learning projects.

  • Data Infrastructure Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    About the RoleWe are looking for a highly skilled Data Infrastructure Architect to join our team. As a data infrastructure architect, you will be responsible for designing and implementing scalable data infrastructure solutions using cloud-based technologies.Your primary focus will be on building and maintaining architecture patterns for data processing,...

  • Big Data Solutions Architect

    1 dzień temu

    Wrocław, Województwo dolnośląskie, Polska Grid Dynamics Poland Pełny etat

    Job OverviewWe're looking for a skilled Big Data Engineer to join our team at Grid Dynamics. As a key member of our data engineering team, you'll be responsible for designing and developing high-performance data analytics platforms using Apache Druid, Spark, and Airflow.ResponsibilitiesDevelop and implement data pipelines for petabyte datasetsOptimize data...

  • Chief Data Architect

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Kdr HR Pełny etat

    Kdr HR is seeking a highly skilled Chief Data Architect to lead the design and implementation of large-scale data processing systems. As a key member of our team, you will provide strategic insights that drive business success. Your expertise in big data technologies, cloud services, and data architectures will enable us to deliver robust and efficient data...

  • Remote Big Data Tech Leader

    24 godzin temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by  Forbes as one of the top...

  • Big Data Solutions Architect

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    Xebia sp. z o.o. helps businesses drive innovation through digital solutions.We're a partner of AWS, Azure, and GCP, focusing on Cloud-based solutions.About the Role:A Senior Data Engineer's primary responsibility is designing and implementing data platforms to support business growth.This involves collaborating with Platform Engineers to select suitable...

  • Big Data Engineering Specialist

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    We are looking for a skilled Scala/Spark Big Data Developer to join our team at Comscore (via CC). As a key member of our big data engineering team, you will be responsible for designing, implementing, and maintaining petabyte-scale big data pipelines using Scala, Spark, Kubernetes, and other technologies.

  • Big Data Pipeline Architect Needed

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    Xebia sp. z o.o. is looking for a highly skilled Senior Data Engineer to join its team. The successful candidate will have extensive experience working with big data technologies and cloud platforms.About the Role:You will be responsible for designing, building, and maintaining complex data systems and pipelines. You will also mentor junior engineers to help...

  • Big Data Developer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    About the JobWe are seeking a highly skilled Petabyte-Scale Big Data Specialist to join our team at Comscore (via CC). As a key member of our big data team, you will design, implement, and maintain large-scale big data pipelines using Scala, Spark, Kubernetes, and other technologies.About UsComscore is a global leader in media analytics, revolutionizing...

  • Big Data Specialist

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    We are looking for an experienced Big Data Specialist to join our team. As a key member, you will be responsible for designing and implementing cutting-edge big data solutions using Azure cloud services and AI techniques.About the Role:You will work closely with internal stakeholders to identify and prioritize business requirements.You will design and...