Data Engineer

4 tygodni temu

Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.

As a Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:

  • Development and maintenance of a large platform for processing automotive data. A significant amount of data is processed in both streaming and batch modes. The technology stack includes Spark, Cloudera, Airflow, Iceberg, Python, and AWS.
  • Design and development of a universal data platform for global aerospace companies. This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is at the early stages of the development, covering design of architecture and processes as well as giving freedom for technology selection.
  • Centralized reporting platform for a growing US telecommunications company. This project involves implementing BigQuery and Looker as the central platform for data reporting. It focuses on centralizing data, integrating various CRMs, and building executive reporting solutions to support decision-making and business growth.

Your main responsibilities:

  • Develop and maintain a high-performance data processing platform for automotive data, ensuring scalability and reliability.
  • Design and implement data pipelines that process large volumes of data in both streaming and batch modes.
  • Optimize data workflows to ensure efficient data ingestion, processing, and storage using technologies such as Spark, Cloudera, and Airflow.
  • Work with data lake technologies (e.g., Iceberg) to manage structured and unstructured data efficiently.
  • Collaborate with cross-functional teams to understand data requirements and ensure seamless integration of data sources.
  • Monitor and troubleshoot the platform, ensuring high availability, performance, and accuracy of data processing.
  • Leverage cloud services (AWS) for infrastructure management and scaling of processing workloads.
  • Write and maintain high-quality Python (or Java/Scala) code for data processing tasks and automation.

What you'll need to succeed in this role:

  • At least 4 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes.
  • Strong programming skills in Python (or Java/Scala): writing clean code, OOP design.
  • Hands-on with Big Data technologies like Spark, Cloudera, Data Platform, Airflow, NiFi, Docker, Kubernetes, Iceberg, Trino or Hudi.
  • Excellent understanding of dimensional data and data modeling techniques.
  • Experience implementing and deploying solutions in cloud environments.
  • Consulting experience with excellent communication and client management skills, including prior experience directly interacting with clients as a consultant.
  • Ability to work independently and take ownership of project deliverables.
  • Fluent English (at least C1 level).
  • Bachelor's degree in technical or mathematical studies.

Nice to have:

  • Experience with an MLOps framework such as Kubeflow or MLFlow.
  • Familiarity with Databricks, dbt or Kafka.

Discover our perks & benefits:

  • Work in a supportive team of passionate enthusiasts of AI & Big Data.
  • Engage with top-tier global enterprises and cutting-edge startups on international projects.
  • Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
  • Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences, including a partnership with Databricks, which offers industry-leading training materials and certifications.
  • Choose from various employment options: B2B, employment contracts, or contracts of mandate.
  • Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.
  • Participate in team-building events and utilize the integration budget.
  • Celebrate work anniversaries, birthdays, and milestones.
  • Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
  • Get full work equipment for optimal productivity, including a laptop and other necessary devices.
  • With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.
  • Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.
#J-18808-Ljbffr

  • Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    We are looking for a Data Engineer specialized in ingesting, transforming, and managing data from Microsoft Dynamics 365 Finance & Operations.This role is crucial to ensuring data quality and availability for analytical and business teams.Responsibilities:Develop and maintain robust data pipelines to extract and transform data from Dynamics FODesign storage...

  • Data Engineer

    3 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    **Data Engineer*** **reference-number:** 17828 * **posted:** 11 marca 2025 * **form-of-employment:** Kontrakt * **apply-by:** 06 maja 2025 share **About the Role:** We are looking for a skilled Data Engineer with expertise in Python, Azure Databricks (or similar tools), and Azure Cloud to join our team. The ideal candidate should have experience...

  • Senior Data Engineer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    We are seeking a highly skilled Data Engineer to join our team at Addepto. As a key member of our data engineering group, you will play a crucial role in designing, implementing, and optimizing scalable data pipelines on Google Cloud Platform (GCP) using BigQuery for both batch and real-time data processing.In this position, you will work closely with...

  • Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    Data Engineer (AI) - Drive Innovation with DataAre you a seasoned Data Engineer with a passion for AI and a drive to build cutting-edge solutions? Do you thrive in a fast-paced, collaborative environment and enjoy tackling complex data challenges? If so, we have the perfect opportunity for you Join our team and play a key role in integrating AI solutions...

  • Remote Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Soda Data NV Pełny etat

    Soda is looking for a proven VP of Engineering to strengthen our leadership team. You will work alongside our leadership team and report directly to the CPO, working closely the product team to accelerate the delivery of the upcoming product features across Data Observability and Data Testing. Your primary responsibility will be leading the engineering team...

  • Data Engineer Professional

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Experis Manpower Group Pełny etat

    About Experis Manpower Group: We are a leading provider of workforce solutions, connecting talented professionals with businesses that drive growth and innovation. As a skilled Data Engineer, you will play a critical role in helping us achieve our mission.Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate should...

  • Data Engineer Position

    5 dni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.About the RoleThe ideal candidate should have expertise in Python, Azure Databricks (or similar tools), and Azure Cloud. Strong communication skills and a team-oriented mindset are...

  • Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Experis Manpower Group Pełny etat

    About the Role: We are looking for a skilled Data Engineer with expertise in Python, Azure Databricks (or similar tools), and Azure Cloud to join our team. The ideal candidate should have experience in building and optimizing data pipelines, ensuring efficient data processing and integration. Strong communication skills and a team-oriented mindset are...

  • Data Engineer Specialist

    6 godzin temu

    Wrocław, Województwo dolnośląskie, Polska beBee Careers Pełny etat

    Salary: Competitive salary.Job Description:We are seeking a skilled DevOps / Data Engineer to join our team. As a DevOps / Data Engineer, you will work closely with the Hadoop team to design, implement, and maintain large-scale data processing systems.Required Skills and Qualifications:Experience in DevOps practices such as continuous integration, continuous...

  • Data Engineer Specialist

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    Company Overview:At Addepto, we specialize in AI and Big Data consulting and technology. We partner with top-tier global enterprises and pioneering startups to deliver innovative data projects.Job Description:We are seeking a Junior Data Engineer to work with our team of technology experts on challenging projects across various industries. As a Junior Data...

  • Data Systems Engineer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska CSHARK sp. z o.o. Pełny etat

    About the RoleWe are seeking an experienced Data Engineer to join our international team developing software solutions for the manufacturing industry. This role involves designing and implementing scalable backend systems, collaborating with stakeholders, and supporting data engineering processes using modern tools and frameworks.

  • Senior Data Engineer @

    3 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska AVENGA Pełny etat

    We are looking for a skilled Data Engineer with expertise in Python, Azure Databricks (or similar tools), and Azure Cloud to join our team. The ideal candidate should have experience in building and optimizing data pipelines, ensuring efficient data processing and integration. Strong communication skills and a team-oriented mindset are essential to...

  • Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska ITDS Business Consultants Pełny etat

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at ITDS Business Consultants. As a key member of our data platform engineering team, you will be responsible for designing and implementing scalable ELT pipelines on Azure Databricks or BigQuery.About the RoleYou will design and implement cloud-native data ingestion,...

  • Cloud Data Engineer

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Capgemini Pełny etat

    About the RoleWe are seeking a skilled Data Engineer to join our team at Capgemini. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data infrastructure that enables our clients to make informed decisions.Your primary focus will be on building reliable and scalable data pipelines...

  • Data Engineer

    3 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska TN Poland Pełny etat

    Social network you want to login/join with:Client:Groupe SIILocation:Job Category:OtherEU work permit required:YesJob Reference:7d257c63b368Job Views:3Posted:02.04.2025Expiry Date:17.05.2025Job Description:We are looking for a Data Engineer for one of our projects in the automotive industry. This person will be responsible for supporting new BI & Analytics...

  • Senior Data Engineer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska DataRiseLab Sp. z o.o. Pełny etat

    technologies-expected : Microsoft Azure SQL technologies-optional : T-SQL Azure Data Factory Azure SQL Synapse Analytics Databricks Python Scala about-project : We are looking for a Senior Data Engineer who will be responsible for creation, development and management of processes for data transformation and integration with use of Azure stack (Data Factory,...

  • Data Engineer for Scalable Data Solutions

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Comscore Pełny etat

    Job Description:We are seeking an experienced Data Engineer to join our team as a Scala/Spark Big Data Developer. You will design, implement, and maintain petabyte-scale Big data pipelines using Scala, Spark, Kubernetes, and other technologies.

  • Senior Data Engineer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska DataRiseLab Sp. z o.o. Pełny etat

    Senior Data Engineer Miejsce pracy: Wrocław Technologies we use Expected Microsoft Azure SQL Optional T-SQL Azure Data Factory Azure SQL Synapse Analytics Databricks Python Scala About the project We are looking for a Senior Data Engineer who will be responsible for creation, development and management of processes for data transformation and integration...

  • Data Engineer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Gamefound Pełny etat

    Creating and managing datasets, and designing data flowsBuilding and implementing ETL systems and data engineering solutionsDesigning data models and automating processes using scriptsCreating reports and applying design patterns in working with dataLeading projects from concept to implementation – full ownership of solutionsOur requirements:You have at...

  • Data Engineer

    3 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Provectus Pełny etat

    Provectus is looking for a talented and driven Data Engineer to join our growing team. In this pivotal role, you will be responsible for building and managing data pipelines that empower our organization to leverage data for advanced analytics and machine learning initiatives. You will work closely with data scientists, analysts, and other stakeholders to...