Senior Big Data Engineer

2 tygodni temu

Katowice, Silesia, Polska Capgemini Pełny etat

Capgemini Engineering is a world leader in engineering and R&D services. We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds. Every day, we help our clients to accelerate their journey towards Intelligent Industry.

At Capgemini, we are responsible and diverse. Our organization has a strong 55-year heritage and deep industry expertise. Our clients trust us to address the entire breadth of their business needs—from strategy and design to operations. Our actions are fueled by the fast-evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering, and platforms.

The Client is a global visual inspiration social media platform used by people around the world to discover and personalize visual content. Today, more than 450 million people come to the platform every month to explore and experience billions of ideas that have been saved.

The project is all about large-scale Data processing. As a Senior Engineer, you will work on one of the world's largest social media platforms which deals with a few petabytes of data coming to the system daily. You will contribute as part of an R&D self-organized team working in a challenging, innovative environment for our client. You are going to Investigate, create, and implement the solutions for many technical challenges using cutting-edge technologies, including building/enhancing a Big Data processing platform enabling the effective functioning of software used by hundreds of millions of users.

The Team is international; all team members are divided into Scrum teams of 5-7 people. You will contribute as part of an R&D self-organized team working in a challenging, innovative environment for our client.

What do you need to start?

  • Extensive experience as a Big Data Engineer
  • Solid Python and Java coding skill
  • Established big-data systems experience in Hadoop , Spark /SparkSQL, HiveSQL
  • Experience with large-scale graph data storage
  • Effective communication, collaboration, and interpersonal skills
  • Result oriented approach

It's not essential but we appreciate if you also have:

  • Experience with Airflow , Apache Atlas
  • Experience with AWS .
  • Experience with Kafka .

What are you going to do?

  • Obtain tasks from the project lead or Team Lead (TL), prepare and design specifications, and approve them with all stakeholders;
  • Ensure that assigned tasks are executed within set deadlines and required quality objectives;
  • Provide estimations and contribute to the project plan or the assigned area;
  • Analyze the scope of alternative solutions and make decisions about the implementation area based on experience and technical expertise;
  • Lead the functional and architectural design of the assigned areas, making sure design decisions on the project meet architectural and design requirements;
  • Address risks, provide and implement mitigation plans;
  • Initiate and conduct code reviews, create code standards, conventions, and guidelines;
  • Suggest technical and functional improvements to add value to the product.

What have we prepared for you?

Space where you can develop yourself:

  • Focus on Innovation and R&D: while working at Capgemini Engineering, you will be using cutting-edge technologies to work on global international projects (both large-scale ones and start-ups) to gain multi-sector expertise;
  • Training/Learning opportunities: external courses, education & certificates co-funding, 70+ certification preparation pathways with further certification (e. g. MS Azure, AWS, Google) on our NEXT learning platform as well as free access to Pluralsight, Service Now, TED Talks, Coursera courses, and virtual trainings.

Our famous atmosphere:

Capgemini Engineering is recognized for its flexibility when it comes to its employees' preferences, caring for the employees' well-being, and promoting its own values. We are trying our best to match the project with the talent. We also give our team members an opportunity to choose what career path they want to pursue.

A lot of benefits:

  • Elastic working hours/a hybrid working model consisting of 70% remote work and 30% office work (depends on the project, too);
  • Private medical care that can be extended by a package of dental services purchased on preferential terms;
  • Private life insurance which can be extended by an oncology package purchased on preferential terms;
  • Referral bonuses for recommending your friends to Capgemini Engineering;
  • Access to our NAIS benefit platform (40+ options available: Netflix, Spotify, Multisport, cinema tickets, etc. );
  • Offices in great locations, a car leasing program, carpooling options, and bicycle parking;
  • Tax-deductible costs for creative work (KUP).

Who are we?

As an integral part of the Capgemini Group, at Capgemini Engineering we combine world-leading Engineering, Research and Development services with digital manufacturing expertise to create innovative and world-changing solutions on an international scale.

Our team is more than 52, 000 engineers and scientists in over 30 countries across sectors including Software & Internet, Data and AI, Aeronautics, Automotive, Railways, Communications, Energy, Life Sciences, Semiconductors, Aerospace & Defense, and Consumer Products.

Do you want to get to know us better?

Visit our website:

Firma: Capgemini

Dodano:
Praca na stanowisku - aktualna

Praca Katowice - Ciekawe oferty pracy w okolicy:
#J-18808-Ljbffr

  • Senior Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska SAVENTIC HEALTH sp. z o.o. Pełny etat

    Senior Data Engineer Katowice Katowice, Silesian Voivodeship, Polska Introduction to Saventic:Saventic Health - we are an international scale-up company focusing on innovations in rare diseases. We create algorithms, based on artificial intelligence, to support the diagnosis of rare diseases. We represent a unique team of professionals in medicine, science,...

  • Junior Big Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska 3Soft SA Pełny etat

    Administrowaniem ekosystemami Big Data w środowiskach On-Premise oraz chmurowych (Cloudera/Spark/Databricks).Rozwijaniem platform Big Data i wdrażaniem jej środowisk.Diagnozą i rozwiązywaniem problemów systemowych występujących w działających środowiskach.Tworzeniem autorskich rozwiązań usprawniających pracę ekosystemu Big Data.Instalacją...

  • Senior Backend Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Kalepa Pełny etat

    Senior Backend Data Engineer Katowice, Silesian Voivodeship Senior Backend Data Engineer Katowice Katowice, Silesian Voivodeship, Polska Who are we?Kalepa is a fully remote startup dedicated to enhancing underwriting performance and driving profitable premium growth for the commercial insurance industry. Kalepa's AI-powered Copilot software enables...

  • Senior Java Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Big Island Motors Pełny etat

    The role focuses on innovating the future of data platform architecture to enable massive scaling and data processing for machine learning (ML) and General AI projects. The successful candidate will build next-generation data platform tooling and services to support the ingestion and processing of billions of documents at scale. They will also improve and...

  • Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska SCALO Sp. z o.o. Pełny etat

    Jesteśmy firmą technologiczną. Realizujemy projekty. Budujemy zespoły. Zapewniamy specjalistów do projektów. Za pomocą technologii wspieramy wzrost biznesowy naszych Klientów oraz tworzymy przestrzeń do ciągłego rozwoju naszego zespołu. Nasze Center of Excellence skupia najlepszych specjalistów SCALO, zajmujących się różnymi dziedzinami...

  • Senior Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat

    Company DescriptionVattenfall is a European energy company with a long history of powering industries and homes through innovation. The company is committed to transitioning to fossil-free energy and is seeking talented individuals to join their mission.Job DescriptionTeam – Analytics Hub We are a diverse international team of data professionals working on...

  • Senior Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Vattenfall IT Services PL Pełny etat

    Senior Data Engineer Katowice, Silesian Voivodeship Team – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds...

  • Senior Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the job Team – Analytics Hub Building, deploying and maintaining end-to-end, scalable and reliable analytics solutions. Performing requirement engineering with the business to determine their exact needs. Designing, developing and maintaining data pipelines and ETL processes that ingest, transform and load data from various sources into...

  • Data Infrastructure Engineer

    2 tygodni temu

    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you: are familiar with SRE concepts and System and application monitoring, have knowledge of infrastructure architecture and practices , have good understanding of databases including RDBMS, non-SQL, are experienced with monitoring and observability (ELK stack) , deployment and provisioning automation tools . Docker,...

  • Data Infrastructure Engineer

    2 tygodni temu

    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:Are familiar with SRE concepts and System and application monitoring.Have knowledge of infrastructure architecture and practices.Have a good understanding of databases including RDBMS, non-SQL.Are experienced with monitoring and observability (ELK stack), deployment and provisioning automation tools (Docker, Kubernetes,...

  • Data Infrastructure Engineer

    4 tygodni temu

    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:are familiar with SRE concepts and System and application monitoring,have knowledge of infrastructure architecture and practices , have good understanding of databases including RDBMS, non-SQL,are experienced with monitoring and observability (ELK stack) ,deployment and provisioning automation tools e.g. Docker, Kubernetes,...

  • Data Infrastructure Engineer

    2 miesięcy temu

    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:are familiar with SRE concepts and System and application monitoring,have knowledge of infrastructure architecture and practices , have good understanding of databases including RDBMS, non-SQL,are experienced with monitoring and observability (ELK stack) ,deployment and provisioning automation tools e.g. Docker, Kubernetes,...

  • Senior Software Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Shiji Group Pełny etat

    Job DescriptionAs a Senior Software Engineer specializing in Business Intelligence and Microservices, you'll play a pivotal role in:Designing, maintaining, and extending microservices and capabilities of the BI solutionEngaging in data modeling and analysis to drive informed decisions and optimizationsAssisting fellow team members on a daily basis and...

  • Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Comeon Group Pełny etat

    ComeOn Group in shortFounded in 2008, ComeOn Group is a leading global player in the rapidly growing iGaming market. Having launched its first online brand in 2010, ComeOn Group is running a wide range of exciting brands across multiple markets. Managing a multi brand portfolio on its proprietary platform providing a secure, innovative and entertainment-led...

  • Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Capgemini Polska Pełny etat

    Technologies-expected:SQLGCPBig QuerySparkHadoopResponsibilities:Design, build, and maintain data infrastructureEnsure data quality and integrityTranslate data needs into technical requirementsImplement data security and privacy policiesOptimize data processing and storage performanceStay updated with data engineering trendsProvide mentorship to junior data...

  • Senior Software Frontend Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Klient Just Join IT Pełny etat

    Senior Software Frontend Engineer Katowice, Silesian Voivodeship Senior Software Frontend Engineer Katowice Katowice, Silesian Voivodeship, Polska 90% of all world trade is handled by the global shipping industry, delivering critical energy, food and raw materials to 7 billion people. Our team is behind solutions that have streamlined many of these processes...

  • Senior Data Engineer

    2 tygodni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Senior Data Engineer

    1 miesiąc temu

    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Senior Data Engineer

    4 tygodni temu

    Katowice, Silesia, Polska Vattenfall Pełny etat

    Job DescriptionTeam – Analytics Hub We are a virtual international team of data engineers, analysts and scientists who work on various data projects supporting one of the Vattenfall's fastest growing Business Units – Distribution Sweden. The majority of this Analytics Hub are data engineers of various backgrounds organized in four scrum teams with four...

  • Data Infrastructure Engineer

    2 tygodni temu

    Katowice, Silesia, Polska ING Bank N.V. Pełny etat

    We are looking for you, if you:are familiar with SRE concepts and System and application monitoring,have knowledge of infrastructure architecture and practices,have good understanding of databases including RDBMS, non-SQL,are experienced with monitoring and observability (ELK stack),deployment and provisioning automation tools e.g. Docker, Kubernetes,...