Senior Data Engineer

4 dni temu


Opole, Opole Voivodeship, Polska BCF Software Sp. z o.o. Pełny etat
Technologies we useExpected
  • PySpark
  • Python
  • Docker
  • SQL
Optional
  • AWS
  • Databricks
About the project

We are excited to present an opportunity for a Senior Data Engineer to join our client's team, contributing to the development of an innovative blockchain crypto solution. This role offers the chance to work on cutting-edge technology that helps audit teams verify client assets, including cryptocurrencies. If you are passionate about data engineering, blockchain, and large-scale systems, this is the perfect role for you

Your responsibilities
  • Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks.
  • Implement data orchestration workflows using Airflow or similar tools.
  • Manage and optimize data storage solutions on Azure Cloud.
  • Develop and maintain containerized microservices using Docker.
  • Collaborate with cross-functional teams to ensure data quality and integrity.
  • Support blockchain setups and build tools to extract data from blockchains for analysis using Databricks.
  • Maintain production infrastructure, ensuring effective monitoring and automation with tools like Datadog.
  • Participate in agile development, planning, and work within cross-functional teams.
Our requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
  • Advanced knowledge of Python for data processing and scripting.
  • Proven experience with Spark and SQL for data engineering and analysis.
  • Experience with data orchestration tools like Airflow.
  • Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
  • Proficiency in RDBMS/NoSQL databases.
  • Experience with Docker containerization (Kubernetes is a plus).
  • Strong understanding of the software development lifecycle.
  • Familiarity with blockchain technologies and data structures.
  • Strong communication and interpersonal skills.
Optional
  • Cryptography knowledge in blockchain is a plus.
  • Databricks experience and familiarity with Delta Lake are pluses.
This is how we organize our workThis is how we work
  • At the client's site
  • You can change the project
  • You have influence on the choice of tools and technologies
  • You have influence on the technological solutions applied
  • You have influence on the product
  • Scrum
This is how we work on a project
  • Clean Code
  • Code quality measures
  • Code review
  • Design patterns
  • Static code analysis
  • BDD
  • Event modeling
  • TDD
  • Architect / technical leader support
  • DevOps
  • Active monitoring
  • Documentation
  • Issue tracking tools
  • NFR
  • Integration tests
  • Testing environments
  • Unit tests
Development opportunities we offer
  • External training
  • Industry-specific e-learning platforms
  • Space for experimenting
  • Substantive support from technological leaders
  • Support of IT events
  • Technical knowledge exchange within the company
  • Sharing the costs of sports activities
  • Private medical care
  • Sharing the costs of foreign language classes
  • Life insurance
  • Remote work opportunities
  • Flexible working time
Recruitment stages
  • Screening
  • Interview with a decision maker
#J-18808-Ljbffr

  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    Company OverviewCapgemini Engineering is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. Our purpose is to unleash human energy through technology for an inclusive and sustainable future.About the JobWe are seeking a skilled Data Engineer to join our growing team of analytics experts....


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the RoleWe are seeking a talented Senior Data Engineer to join our team at Capgemini Engineering. In this role, you will be responsible for designing, building, and maintaining robust and efficient data pipelines to support various products and business needs.Key ResponsibilitiesDesign and Implementation:Design data models for efficient storage and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the TeamAt Capgemini Engineering, we have a diverse team of engineers, scientists, and architects who work together to help the world's most innovative companies unleash their potential.We use cutting-edge technologies like AI, machine learning, and cloud computing to drive innovation and growth.Our team members are passionate about what they do and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the RoleAt Capgemini Engineering, we are seeking a skilled Data Engineer to join our growing team of analytics experts. This role will involve expanding and optimizing our data pipeline architecture, ensuring optimal data delivery for cross-functional teams.Design and implement scalable data pipelines using big data technologies like Hadoop and...

  • Data Engineer

    3 dni temu


    Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...


  • Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etat

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...


  • Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etat

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...


  • Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etat

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...

  • Big Data Expert

    2 dni temu


    Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    A Day in the LifeAs a Senior Data Engineer at Capgemini Engineering, your day will be filled with designing, building, and maintaining robust and efficient data pipelines to support various products and business needs.ResponsibilitiesDesign and Development:Design data models for efficient storage and retrieval to meet critical product and business...

  • Senior Data Engineer

    1 tydzień temu


    Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    The Ideal CandidateWe are looking for a highly skilled and experienced Senior Data Engineer who is passionate about designing, building, and maintaining robust and efficient data pipelines.RequirementsSkills and Qualifications:9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD.Extensive experience designing, building, and...

  • Support Engineer

    2 dni temu


    Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the JobThis is an exciting opportunity to join our dynamic team as a Support Engineer - Data Integrity. In this role, you will work closely with our clients to ensure seamless integration and optimal performance of our data governance platform. Your strong technical skills and excellent communication abilities will enable you to provide top-notch...

  • Azure Data Engineer @

    3 tygodni temu


    Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etat

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    Deliver InnovationCapgemini Engineering is a leading provider of engineering services, seeking a skilled Senior Backend Engineer for Large-Scale Systems to join our team of experts.We are committed to delivering high-quality solutions and exceptional customer service. As a senior engineer, you will lead the development of complex software systems and drive...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the RoleAs a seasoned Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems that drive business growth and innovation. Your expertise in stream-processing systems, such as Apache Spark and/or Kafka Streaming, Storm, etc., will enable us to optimize our data pipeline architecture and improve data...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    About the JobWe are looking for a talented Big Data Engineer to join our team at Capgemini Engineering. In this role, you will be responsible for designing and implementing scalable data pipelines using big data technologies.Develop data ingestion processes using streaming systems like Kafka and Spark Streaming.Create and manage data storage solutions using...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    Data Engineer Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Capgemini Engineering. The ideal candidate will have a strong background in data engineering, with experience working with relational databases and data warehouses, stream-processing systems, programming and scripting languages, big data tools, and NoSQL data...


  • Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etat

    Job DescriptionWe are looking for a Data Engineer to join our team at Capgemini Engineering. As a member of our analytics team, you will be responsible for designing, implementing, and maintaining large-scale data systems that drive business growth and innovation.Build analytics tools that utilize the data pipeline to provide actionable insights into...