Senior Data Engineer
4 dni temu
- PySpark
- Python
- Docker
- SQL
- AWS
- Databricks
We are excited to present an opportunity for a Senior Data Engineer to join our client's team, contributing to the development of an innovative blockchain crypto solution. This role offers the chance to work on cutting-edge technology that helps audit teams verify client assets, including cryptocurrencies. If you are passionate about data engineering, blockchain, and large-scale systems, this is the perfect role for you
Your responsibilities- Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks.
- Implement data orchestration workflows using Airflow or similar tools.
- Manage and optimize data storage solutions on Azure Cloud.
- Develop and maintain containerized microservices using Docker.
- Collaborate with cross-functional teams to ensure data quality and integrity.
- Support blockchain setups and build tools to extract data from blockchains for analysis using Databricks.
- Maintain production infrastructure, ensuring effective monitoring and automation with tools like Datadog.
- Participate in agile development, planning, and work within cross-functional teams.
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Advanced knowledge of Python for data processing and scripting.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with data orchestration tools like Airflow.
- Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
- Proficiency in RDBMS/NoSQL databases.
- Experience with Docker containerization (Kubernetes is a plus).
- Strong understanding of the software development lifecycle.
- Familiarity with blockchain technologies and data structures.
- Strong communication and interpersonal skills.
- Cryptography knowledge in blockchain is a plus.
- Databricks experience and familiarity with Delta Lake are pluses.
- At the client's site
- You can change the project
- You have influence on the choice of tools and technologies
- You have influence on the technological solutions applied
- You have influence on the product
- Scrum
- Clean Code
- Code quality measures
- Code review
- Design patterns
- Static code analysis
- BDD
- Event modeling
- TDD
- Architect / technical leader support
- DevOps
- Active monitoring
- Documentation
- Issue tracking tools
- NFR
- Integration tests
- Testing environments
- Unit tests
- External training
- Industry-specific e-learning platforms
- Space for experimenting
- Substantive support from technological leaders
- Support of IT events
- Technical knowledge exchange within the company
- Sharing the costs of sports activities
- Private medical care
- Sharing the costs of foreign language classes
- Life insurance
- Remote work opportunities
- Flexible working time
- Screening
- Interview with a decision maker
-
Senior Big Data Engineer
4 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Senior Data Systems Engineer
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatCompany OverviewCapgemini Engineering is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. Our purpose is to unleash human energy through technology for an inclusive and sustainable future.About the JobWe are seeking a skilled Data Engineer to join our growing team of analytics experts....
-
Senior Data Architect
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the RoleWe are seeking a talented Senior Data Engineer to join our team at Capgemini Engineering. In this role, you will be responsible for designing, building, and maintaining robust and efficient data pipelines to support various products and business needs.Key ResponsibilitiesDesign and Implementation:Design data models for efficient storage and...
-
Senior Data Scientist
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the TeamAt Capgemini Engineering, we have a diverse team of engineers, scientists, and architects who work together to help the world's most innovative companies unleash their potential.We use cutting-edge technologies like AI, machine learning, and cloud computing to drive innovation and growth.Our team members are passionate about what they do and...
-
Data Engineer Specialist
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the RoleAt Capgemini Engineering, we are seeking a skilled Data Engineer to join our growing team of analytics experts. This role will involve expanding and optimizing our data pipeline architecture, ensuring optimal data delivery for cross-functional teams.Design and implement scalable data pipelines using big data technologies like Hadoop and...
-
Data Engineer
3 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Azure Senior Data Engineer @
3 tygodni temu
Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etatAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
GCP Senior Data Engineer @
3 tygodni temu
Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etatAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
Azure Senior Data Engineer @
4 tygodni temu
Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etatAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
Big Data Expert
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatA Day in the LifeAs a Senior Data Engineer at Capgemini Engineering, your day will be filled with designing, building, and maintaining robust and efficient data pipelines to support various products and business needs.ResponsibilitiesDesign and Development:Design data models for efficient storage and retrieval to meet critical product and business...
-
Senior Data Engineer
1 tydzień temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Enterprise Data Solution Specialist
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatThe Ideal CandidateWe are looking for a highly skilled and experienced Senior Data Engineer who is passionate about designing, building, and maintaining robust and efficient data pipelines.RequirementsSkills and Qualifications:9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD.Extensive experience designing, building, and...
-
Support Engineer
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the JobThis is an exciting opportunity to join our dynamic team as a Support Engineer - Data Integrity. In this role, you will work closely with our clients to ensure seamless integration and optimal performance of our data governance platform. Your strong technical skills and excellent communication abilities will enable you to provide top-notch...
-
Azure Data Engineer @
3 tygodni temu
Opole, Opole Voivodeship, Polska Capgemini Polska Sp. z o.o. Pełny etatAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
Senior Backend Engineer for Large-Scale Systems
22 godzin temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatDeliver InnovationCapgemini Engineering is a leading provider of engineering services, seeking a skilled Senior Backend Engineer for Large-Scale Systems to join our team of experts.We are committed to delivering high-quality solutions and exceptional customer service. As a senior engineer, you will lead the development of complex software systems and drive...
-
Business Data Architect
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the RoleAs a seasoned Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems that drive business growth and innovation. Your expertise in stream-processing systems, such as Apache Spark and/or Kafka Streaming, Storm, etc., will enable us to optimize our data pipeline architecture and improve data...
-
Senior DB2 Database Engineer
1 tydzień temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Big Data Pipeline Architect
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatAbout the JobWe are looking for a talented Big Data Engineer to join our team at Capgemini Engineering. In this role, you will be responsible for designing and implementing scalable data pipelines using big data technologies.Develop data ingestion processes using streaming systems like Kafka and Spark Streaming.Create and manage data storage solutions using...
-
Cloud Data Engineering Leader
4 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatData Engineer Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Capgemini Engineering. The ideal candidate will have a strong background in data engineering, with experience working with relational databases and data warehouses, stream-processing systems, programming and scripting languages, big data tools, and NoSQL data...
-
Data Infrastructure Specialist
2 dni temu
Opole, Opole Voivodeship, Polska Capgemini Engineering Pełny etatJob DescriptionWe are looking for a Data Engineer to join our team at Capgemini Engineering. As a member of our analytics team, you will be responsible for designing, implementing, and maintaining large-scale data systems that drive business growth and innovation.Build analytics tools that utilize the data pipeline to provide actionable insights into...