big data engineer
3 dni temu
CAPCO POLAND
*We are looking for a Krakow or nearby based candidate.
Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success.
Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.
We are seeking a skilled and passionate Data Engineer to join our dynamic team. This is an exciting opportunity for individuals with experience in building and managing data pipelines, and working with cloud technologies like Google Cloud Platform (GCP). If you're someone who thrives in a collaborative environment and enjoys problem-solving with cutting-edge tools, we'd love to meet you
BIG DATA ENGINEER @ CAPCO - WHAT TO EXPECT
- You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
- You'll be part of a digital engineering team that develops new and enhances existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
- You'll be involved in digital and data transformation processes through a continuous delivery model.
- You will work on automating and optimizing data engineering processes, develop robust and fault-tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
- You'll be able to work across different data, cloud, and messaging technology stacks.
- You'll have an opportunity to learn and work with specialized data and cloud technologies to widen the skill set.
Key Responsibilities:
- Design, implement, and manage scalable data pipelines using Google Cloud Platform (GCP) services, such as BigQuery, Google Cloud Storage (GCS), and DataProc.
- Build and optimize data workflows using SQL, NoSQL databases, and APIs.
- Collaborate with cross-functional teams to gather requirements and ensure that data infrastructure supports the broader business objectives.
- Write efficient, maintainable code in Python for data processing and integration tasks.
- Troubleshoot and resolve issues related to data pipelines, databases, and cloud services.
- Ensure data quality, reliability, and security throughout the data pipeline lifecycle.
- Actively contribute to the design of new systems and maintain or upgrade existing data infrastructure.
- Contribute to security designs and have advanced knowledge of key security technologies e.g. TLS, OAuth, Encryption.
- Support internal Capco capabilities by sharing insight and experience.
- Hands-on experience with Google Cloud Platform (GCP), including BigQuery, GCS, and DataProc.
- Strong proficiency in Python programming for data engineering tasks.
- Proven experience working with SQL and NoSQL databases.
- Solid understanding of building and maintaining data pipelines using APIs.
- Knowledge of data pipeline orchestration and optimization techniques.
- Experience working with large-scale data sets and cloud-based data storage systems.
- Strong problem-solving abilities and a keen attention to detail.
- Knowledge of PySpark for large-scale data processing.
- Familiarity with data engineering best practices and emerging technologies.
WHY JOIN CAPCO?
- Employment contract and/or Business to Business - whichever you prefer.
- Possibility to work remotely.
- Speaking English on a daily basis, mainly in contact with foreign stakeholders and peers.
- Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance).
- Access to 3,000+ Business Courses Platform (Udemy).
- Access to required IT equipment.
- Paid Referral Program.
- Participation in charity events e.g. Szlachetna Paczka.
- Ongoing learning opportunities to help you acquire new skills or deepen existing expertise.
- Being part of the core squad focused on the growth of the Polish business unit.
- A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients.
- A work culture focused on innovation and creating lasting value for our clients and employees.
ONLINE RECRUITMENT PROCESS STEPS*
- Screening call with the Recruiter.
- Technical interview: first stage.
- Client Interview.
- Feedback/Offer.
-
Big Data Engineer
6 dni temu
Kraków, Lesser Poland Experis ManpowerGroup Sp. z o.o. Pełny etatResponsibilities:Designing, building, and managing scalable big data architectures and solutionsDeveloping and optimizing data pipelines for processing large-scale datasetsIntegrating and processing data from various sources to enable analytics and reportingEnsuring the data infrastructure is robust, reliable, and efficientCollaborating with data scientists,...
-
Mid Big Data Engineer
5 dni temu
Kraków, Lesser Poland Promote Project Pełny etatKraków, Lesser Poland Voivodeship, Poland57500 - 92500 a year (Zlotys)DescriptionCAPCO POLAND*We are looking for Poland based candidate. The job is remote but may require some business trips.Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate...
-
Big Data Engineer
3 tygodni temu
Kraków, Lesser Poland ITDS Pełny etatJoin us, and bring your expertise to a world-class tech initiative.Krakow-based opportunity with the possibility to work 75% remote.As a Big Data Engineer, you will be working for our client, a global financial institution. The team focuses on enhancing security and compliance by building data processing solutions and storage technologies to monitor and...
-
Big Data Engineer Manager
3 dni temu
Kraków, Lesser Poland HR-Line Pełny etatThe Role:This is a unique opportunity to join a leading global bank as a Data Engineer. You will be part of a dynamic team, developing and enhancing financial and data solutions. The role involves working on greenfield projects and Tier 1 bank applications, contributing to digital and data transformation through a continuous delivery model.Key...
-
Lead Big Data Engineer
3 dni temu
Kraków, Lesser Poland Luxoft Pełny etat4 days ago Be among the first 25 applicantsPrivate Medical & Dental care & Life Insurance coveredInternal Mobility program - possibility of rotation between projects, locations, accounts...and moreProject Description:The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large...
-
Lead Big Data Engineer
2 dni temu
Kraków, Lesser Poland Luxoft Poland Pełny etat1 week ago Be among the first 25 applicantsDirect message the job poster from Luxoft PolandSenior IT Researcher at Luxoft, a DXC Technology CompanyProject DescriptionThe project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT...
-
Big Data Engineer
2 tygodni temu
Kraków, Lesser Poland Capco Poland Pełny etat*We are looking for Poland based candidate. Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a...
-
Big Data Specialist
5 dni temu
Kraków, Lesser Poland GlobalLogic Pełny etat**Benefits of Working at GlobalLogic**We offer a range of benefits to our employees, including comprehensive training programs, flexible work arrangements, and opportunities for career advancement.As a Big Data Specialist on our team, you will have the opportunity to work on challenging projects and develop your skills in big data technologies, cloud...
-
Big Data Developer
2 tygodni temu
Kraków, Lesser Poland Arche Consulting Pełny etatBig Data Developer87_28626Obowiązkifacilitate the establishment of a secure data platform on BBH's OnPrem Cloudera infrastructure, document and develop ETL logic and data flows to facilitate the easy usage of data assets, both batch and real-time streaming, leverage the following (but not limited to) components of Cloudera distribution to achieve project...
-
Big Data Solution Architect
5 dni temu
Kraków, Lesser Poland Heineken Pełny etatAbout the RoleThe Data Foundation Team at Heineken is looking for a skilled Senior Data Engineer to lead the development of big data solutions. As a key member of our team, you will be responsible for mentoring junior engineers, ensuring adherence to coding standards, and driving operational excellence.Main Responsibilities:Mentor junior engineers in...
-
Big Data Architect
8 godzin temu
Kraków, Lesser Poland GlobalLogic Pełny etatWe are seeking a Big Data Architect to join our Data Mesh platform team at GlobalLogic. As a Big Data Architect, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes.You will collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions. Your expertise...
-
Big Data Engineering Expert
7 dni temu
Kraków, Lesser Poland LoopMe Pełny etatJob Description:We are seeking a highly skilled Software Engineer with experience designing, building, and maintaining high-scale, big-data distributed systems. The successful candidate will collaborate on designing and setting up new features and system improvements, manage and optimize cloud infrastructure on Google Cloud Platform (GCP), lead efforts to...
-
Big Data Engineering Lead
5 dni temu
Kraków, Lesser Poland Promote Project Pełny etat**About the Role**We are seeking a highly skilled Big Data Engineer to join our team at Promote Project. The successful candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on cloud projects for large-scale data processing and analytics.As a key member of our data engineering squad, you will work...
-
Big Data Architect Lead
7 dni temu
Kraków, Lesser Poland Addepto Pełny etatJob ResponsibilitiesAs a Senior Data Engineer, you will be responsible for designing and optimizing scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster. You will also architect and implement end-to-end data platforms, ensuring high availability, performance, and...
-
Big Data Systems Developer
7 dni temu
Kraków, Lesser Poland Autodesk, Inc. Pełny etatRole SummaryAutodesk, Inc. is looking for a highly skilled Principal Data Engineer/Prompt Engineer to join our team. As a key member of our Global Delivery Team, you will be responsible for designing, developing, and implementing data engineering solutions to support business growth and innovation.Main ResponsibilitiesDesign and develop scalable data...
-
Lead Big Data Engineer
2 dni temu
Kraków, Lesser Poland Luxoft Pełny etatProject Description:The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data...
-
Senior Big Data Specialist
1 dzień temu
Kraków, Lesser Poland Capco Pełny etatCapco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We're seeking a skilled Senior Big Data Engineer to join our Team.About the Role:Join us in shaping the future of data processing and analytics.Collaborate with clients to define industry-leading...
-
Lead Big Data Engineer
3 dni temu
Kraków, Lesser Poland Luxoft Poland Pełny etatThe project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data Lakehouse architecture to...
-
Big Data Specialist
4 dni temu
Kraków, Lesser Poland TN Poland Pełny etatData Specialist Job DescriptionTN Poland is seeking a highly skilled Big Data Specialist to join our team. In this role, you will lead the design and implementation of large-scale data processing systems, providing strategic insights that drive business success.The ideal candidate will have a strong background in big data processing and cloud technologies,...
-
Big Data Solutions Architect
6 dni temu
Kraków, Lesser Poland Experis ManpowerGroup Sp. z o.o. Pełny etatJob OverviewExperis ManpowerGroup Sp. z o.o. seeks a Cloud-Based Data Analytics Expert to design, build, and manage scalable big data architectures and solutions.Key Responsibilities:Develop and optimize data pipelines for processing large-scale datasets, focusing on high-quality and timely delivery.Collaborate with cross-functional teams to integrate and...