Big Data Pipeline Developer

5 dni temu

Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat
About Xebia

Xebia is a rapidly growing digital solutions developer with a strong presence in Poland and beyond. For nearly two decades, we have been creating innovative technologies for global brands like UPS, McLaren, Aviva, and Deloitte.

We are passionate about cloud-based solutions, partnering with leading cloud providers like AWS, Microsoft Azure, and Google Cloud Platform (GCP).

As part of the Xebia Group, we aim to make a lasting impact in the world of technology through innovation, talented team members, and technological excellence.

Our mission is to establish ourselves as authorities in our area of expertise.

The key to our success lies in our attitude, dedication to knowledge, and belief in people's potential – emphasizing every team member's development.

About the Role:

We are seeking a skilled Data Engineer to join our team at Xebia. As a Data Engineer, you will collaborate closely with engineering, product, and data teams to design, build, and maintain data platforms and pipelines, ensuring seamless data flows and delivering robust data solutions to our clients.

Your Key Responsibilities:
  • Developing and maintaining data pipelines to ensure seamless data flows
  • Ensuring data integrity, consistency, and availability across all data systems
  • Integrating data from various sources into the data lake
  • Implementing ETL processes to transform and load data into the data warehouse for analytics and reporting
  • Working closely with cross-functional teams to understand data requirements and deliver solutions
  • Collaborating with data engineers to ensure data engineering best practices are integrated into the development process
  • Optimizing data storage and retrieval to improve performance and scalability
  • Monitoring and troubleshooting data pipelines to ensure high reliability and efficiency
  • Implementing and enforcing data governance policies to ensure data security, privacy, and compliance
  • Developing documentation and standards for data processes and procedures
Your Profile:

To be successful in this role, you should have 3+ years of experience in a data engineering position, with hands-on experience in building data processing pipelines. Proficiency in Python, SQL, and Apache Airflow is also essential.

In addition, you should have extensive experience with modern data libraries and frameworks, such as Databricks, Snowflake, and Spark. Hands-on experience with ETL tools and processes, as well as a deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts, are highly desirable.

You must also have excellent command of oral and written English and be available to start within a short time frame.

A Bachelor's or Master's degree in Computer Science, Information Systems, or a related field is required, and work permit for the European Union region is necessary.

  • Big Data Developer Scala Specialist

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Correctcontext Pełny etat

    At Correct Context, we're on a mission to revolutionize insights into consumer behavior, media consumption, and digital engagement. As a key member of our team, you'll have the opportunity to work with cutting-edge technology and contribute to empowering businesses in the digital era across various sectors.We're looking for a highly skilled Scala/Linux Big...

  • Scala/Linux Big Data Developer @

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Correct Context is looking for a  Scala/Linux Big Data Developer for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...

  • Java/Spark Big Data Developer @

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Correct Context is looking for a  Java/Spark Big Data Developer  for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...

  • Data Pipeline Engineer

    3 dni temu

    Wrocław, Województwo dolnośląskie, Polska Tbwa ChiatDay Inc Pełny etat

    Tbwa Chiat/Day Inc. is looking for a skilled Java Developer to join its Engineering team. The ideal candidate will have strong software engineering skills and be interested in working with data.About UsWe are the emerging leader in cloud communications, providing APIs and SDKs for real-time customer connections worldwide.The RoleThis role involves designing...

  • Senior Big Data Developer Role

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    This Senior Big Data Developer Role requires an experienced professional with expertise in Python, Azure Databricks, and Azure Cloud. The ideal candidate will have a proven track record of building and optimizing data pipelines, ensuring efficient data processing and integration, and collaborating with cross-functional teams.Our Offer:MEDICOVER benefits...

  • Scala/Linux Big Data Developer Comscore · Ruska 3, Wrocław

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Correctcontext Pełny etat

    Correct Context is looking for a Scala/Linux Big Data Developer for Comscore in Poland and around.Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...

  • Linux Big Data Engineer Position

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Correctcontext Pełny etat

    Are you passionate about leveraging cutting-edge technology to drive business growth? Do you have expertise in Scala and Linux development? We're seeking an experienced Scala/Linux Big Data Developer to join our team at Correct Context.In this role, you'll design, implement, and maintain complex big data pipelines using Scala, Kubernetes, and other...

  • Big Data Architect

    7 dni temu

    Wrocław, Województwo dolnośląskie, Polska TN Poland Pełny etat

    TN Poland is a leading company in the field of modern technologies, and we are looking for a highly skilled Big Data Architect to join our team. As a key member of our technology division, you will be responsible for designing and developing data architectures using Snowflake.The ideal candidate will have experience working with public cloud platforms and a...

  • Data Analytics Developer with Scala Skills

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Correctcontext Pełny etat

    We're Correct Context, a global leader in media analytics, and we're seeking an experienced Scala/Linux Big Data Developer to join our team. In this role, you'll design, implement, and maintain petabyte-scale Big data pipelines using Scala, Kubernetes, and other technologies.The ideal candidate will have:2+ years of experience with Linux and solid knowledge...

  • Lead Big Data Engineer

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    Are you ready to become one of the Luxofters?Who we are:Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our...

  • Senior Big Data Solutions Architect

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Poland Pełny etat

    As a Senior Big Data Solutions Architect at Luxoft Poland, you will play a crucial role in designing and developing innovative big data solutions for our clients. You will work closely with cross-functional teams to deliver high-quality solutions that meet the evolving needs of our customers.About the JobWe are looking for an experienced architect who can...

  • Big Data and Data Lake Architect

    5 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Poland Pełny etat

    ResponsibilitiesThe Big Data and Data Lake Architect will play a critical role in designing and implementing big data solutions using Azure technologies, ensuring high-quality, secure, and scalable data processing platforms.Your key responsibilities will include:Designing and implementing ETL/ELT pipelines using cloud infrastructure effectively.Developing...

  • Azure Big Data Architect

    5 dni temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    Job SummaryWe are seeking an experienced Azure Big Data Architect to join our team at Xebia sp. z o.o. This is an exciting opportunity for a talented individual with extensive experience in big data, cloud computing, and Azure technologies.About the RoleThe successful candidate will be responsible for leading the design, build, and deployment of large-scale...

  • Lead Big Data Engineer

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Poland Pełny etat

    The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data Lakehouse architecture to...

  • Data Pipeline Specialist in Pharmaceutical Industry

    7 dni temu

    Wrocław, Województwo dolnośląskie, Polska Sii Sp. z o.o. Pełny etat

    Key ResponsibilitiesDesign, develop, and maintain data pipelines and systems that support clinical and operational data use casesPackaging image processing tasks such as Cellpose on the CPU and GPUContribute to a flexible job architecture that enables scalable processing on the backend of computingDevelop web-based graphical interfaces for running workflows...

  • Java Developer

    3 dni temu

    Wrocław, Województwo dolnośląskie, Polska Tbwa ChiatDay Inc Pełny etat

    Tbwa Chiat/Day Inc. is seeking a Data Pipeline Engineer to join its team. As a Data Pipeline Engineer, you will design and build systems to process and analyze tens of millions of daily events.About UsWe are the emerging leader in cloud communications, providing APIs and SDKs for real-time customer connections worldwide.The RoleThis role involves working...

  • Senior Big Data Solutions Architect

    5 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Poland Pełny etat

    About the RoleThis is an exciting opportunity for a seasoned Senior Big Data Solutions Architect to lead the design and implementation of big data solutions using Azure technologies.You will work closely with cross-functional teams to develop cloud-based data processing platforms, ensuring high-quality, secure, and scalable solutions.Leading the design and...

  • Big Data Engineering Lead

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    We're looking for a skilled Data Processing Specialist to help us build a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets.The ideal candidate will have experience in building Data Processing pipeline using various ETL/ELT design patterns and methodologies to Azure data solution, building...

  • Big Data Engineer Lead

    2 dni temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    We are looking for a highly skilled Big Data Engineer Lead to join our team at Luxoft. As a key member of our data engineering team, you will be responsible for leading the development of our modern cloud-based data processing platform.The ideal candidate will have extensive experience in building data processing pipelines using various ETL/ELT design...

  • Cloud Architect with Big Data Expertise

    7 dni temu

    Wrocław, Województwo dolnośląskie, Polska Capgemini Polska Sp. z o.o. Pełny etat

    We are seeking a Cloud Architect with Big Data Expertise to join our team at Capgemini. In this role, you will design and implement cloud-based data architectures that meet the evolving needs of our clients. With a focus on scalability, security, and performance, you will work closely with data engineers and scientists to deliver cutting-edge solutions that...