Mid Big Data Engineer

6 dni temu


Kraków, Lesser Poland Promote Project Pełny etat

Kraków, Lesser Poland Voivodeship, Poland

57500 - 92500 a year (Zlotys)

Description

CAPCO POLAND

*We are looking for Poland based candidate. The job is remote but may require some business trips.

Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent as we can and we believe that everyone brings something different to the table – so we'd love to know what makes you different.

Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.

We're seeking a skilled Mid Big Data Engineer to join our Team. The ideal candidate will be responsible for designing, implementing and maintaining scalable data pipelines and solutions on on-prem / migration / cloud projects for large scale data processing and analytics.

THINGS YOU WILL DO

  • Design, develop and maintain robust data pipelines using Scala or Python, Spark, Hadoop, SQL for batch and streaming data processing
  • Collaborate with cross-functional teams to understand data requirements and design efficient solutions that meet business needs
  • Optimize Spark jobs and data processing workflows for performance, scalability and reliability
  • Ensure data quality, integrity and security throughout the data lifecycle
  • Troubleshoot and resolve data pipeline issues in a timely manner to minimize downtime and impact on business operations
  • Stay updated on industry best practices, emerging technologies, and trends in big data processing and analytics
  • Document, design specifications, deployment procedures and operational guidelines for data pipelines and systems
  • Provide technical guidance and mentorship for new joiners

TECH STACK: Python or Scala, OOP, Spark, SQL, Hadoop

Nice to have: GCP, Pub/Sub, Big Query, Kafka, Juniper, Apache NiFi, Hive, Impala, Cloudera, CI/CD

SKILLS & EXPERIENCES YOU NEED TO GET THE JOB DONE

  • min. 3-4 years of experience as a Data Engineer/Big Data Engineer
  • University degree in computer science, mathematics, natural sciences, or similar field and relevant working experience
  • Excellent SQL skills, including advanced concepts
  • Very good programming skills in Python or Scala
  • Experience in Spark and Hadoop
  • Experience in OOP
  • Experience using agile frameworks like Scrum
  • Interest in financial services and markets
  • Nice to have: experience or knowledge with GCP
  • Fluent English communication and presentation skills
  • Sense of humor and positive attitude

WHY JOIN CAPCO?

  • Employment contract and/or Business to Business - whichever you prefer
  • Possibility to work remotely
  • Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
  • Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
  • Access to 3.000+ Business Courses Platform (Udemy)
  • Access to required IT equipment
  • Paid Referral Program
  • Participation in charity events e.g. Szlachetna Paczka
  • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  • Being part of the core squad focused on the growth of the Polish business unit
  • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
  • A work culture focused on innovation and creating lasting value for our clients and employees

ONLINE RECRUITMENT PROCESS STEPS*

  • Screening call with the Recruiter
  • Technical interview: first stage
  • Client Interview
  • Feedback/Offer

*The recruitment process may be modified

Please mention the word AUTONOMOUS and tag RMzUuODYuMTY2LjE5OQ== when applying to show you read the job post completely (#RMzUuODYuMTY2LjE5OQ==).

Job type:

Remote job

Tags
  • design
  • security
  • python
  • consultancy
  • technical
  • recruiter
  • growth
  • financial
  • cloud
  • scala
  • management
  • senior
  • operational
  • engineer
  • recruitment
  • apache
  • digital nomad
#J-18808-Ljbffr

  • Kraków, Lesser Poland Luxoft Pełny etat

    4 days ago Be among the first 25 applicantsPrivate Medical & Dental care & Life Insurance coveredInternal Mobility program - possibility of rotation between projects, locations, accounts...and moreProject Description:The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large...


  • Kraków, Lesser Poland Luxoft Poland Pełny etat

    1 week ago Be among the first 25 applicantsDirect message the job poster from Luxoft PolandSenior IT Researcher at Luxoft, a DXC Technology CompanyProject DescriptionThe project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT...


  • Kraków, Lesser Poland TE Connectivity Corporation Pełny etat

    Required SkillsThe ideal candidate for the Big Data Engineer Specialist role should have a strong foundation in programming languages, specifically Python, and experience with AWS services such as Glue, Redshift, and S3.A solid understanding of data modeling and architecture, data processing and ETL, and data warehousing is essential for this...

  • Big Data Engineer

    7 dni temu


    Kraków, Lesser Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    Responsibilities:Designing, building, and managing scalable big data architectures and solutionsDeveloping and optimizing data pipelines for processing large-scale datasetsIntegrating and processing data from various sources to enable analytics and reportingEnsuring the data infrastructure is robust, reliable, and efficientCollaborating with data scientists,...

  • Big Data Engineer

    3 tygodni temu


    Kraków, Lesser Poland ITDS Pełny etat

    Join us, and bring your expertise to a world-class tech initiative.Krakow-based opportunity with the possibility to work 75% remote.As a Big Data Engineer, you will be working for our client, a global financial institution. The team focuses on enhancing security and compliance by building data processing solutions and storage technologies to monitor and...


  • Kraków, Lesser Poland Luxoft Pełny etat

    Project Description:The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data...


  • Kraków, Lesser Poland Luxoft Poland Pełny etat

    The project focuses on building a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets. Key aspects include implementing ETL/ELT pipelines, optimizing data processing, and ensuring compliance with industry regulations. The solution leverages Azure, Apache Spark, and Data Lakehouse architecture to...


  • Kraków, Lesser Poland HR-Line Pełny etat

    The Role:This is a unique opportunity to join a leading global bank as a Data Engineer. You will be part of a dynamic team, developing and enhancing financial and data solutions. The role involves working on greenfield projects and Tier 1 bank applications, contributing to digital and data transformation through a continuous delivery model.Key...


  • Kraków, Lesser Poland Capco Pełny etat

    CAPCO POLAND*We are looking for Poland based candidate. The job is remote but may require some business trips.Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to...

  • Big Data Engineer

    2 tygodni temu


    Kraków, Lesser Poland Capco Poland Pełny etat

    *We are looking for Poland based candidate.  Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a...

  • big data engineer

    4 dni temu


    Kraków, Lesser Poland Capco Pełny etat

    CAPCO POLAND*We are looking for a Krakow or nearby based candidate.Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success.Capco Poland is a global technology and...

  • Big Data Developer

    2 tygodni temu


    Kraków, Lesser Poland Arche Consulting Pełny etat

    Big Data Developer87_28626Obowiązkifacilitate the establishment of a secure data platform on BBH's OnPrem Cloudera infrastructure, document and develop ETL logic and data flows to facilitate the easy usage of data assets, both batch and real-time streaming, leverage the following (but not limited to) components of Cloudera distribution to achieve project...

  • Big Data Specialist

    6 dni temu


    Kraków, Lesser Poland GlobalLogic Pełny etat

    **Benefits of Working at GlobalLogic**We offer a range of benefits to our employees, including comprehensive training programs, flexible work arrangements, and opportunities for career advancement.As a Big Data Specialist on our team, you will have the opportunity to work on challenging projects and develop your skills in big data technologies, cloud...


  • Kraków, Lesser Poland Heineken Pełny etat

    About the RoleThe Data Foundation Team at Heineken is looking for a skilled Senior Data Engineer to lead the development of big data solutions. As a key member of our team, you will be responsible for mentoring junior engineers, ensuring adherence to coding standards, and driving operational excellence.Main Responsibilities:Mentor junior engineers in...

  • Lead Big Data Developer

    2 tygodni temu


    Kraków, Lesser Poland EPAM Systems (Poland) sp. z o.o. Pełny etat

    technologies-expected : Python Scala Java Spark Databricks Microsoft Azure AWS technologies-optional : Hadoop Spark Kafka Oozie Airflow HDFS YARN Solr OpenSearch Lucene about-project : We seek Lead Big Data Developers with cloud experience to join our growing Data Practice. The projects we are working on are diverse, covering all technologies and solutions...

  • Big Data Architect

    1 dzień temu


    Kraków, Lesser Poland GlobalLogic Pełny etat

    We are seeking a Big Data Architect to join our Data Mesh platform team at GlobalLogic. As a Big Data Architect, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes.You will collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions. Your expertise...

  • Big Data Engineering Expert

    1 tydzień temu


    Kraków, Lesser Poland LoopMe Pełny etat

    Job Description:We are seeking a highly skilled Software Engineer with experience designing, building, and maintaining high-scale, big-data distributed systems. The successful candidate will collaborate on designing and setting up new features and system improvements, manage and optimize cloud infrastructure on Google Cloud Platform (GCP), lead efforts to...


  • Kraków, Lesser Poland Promote Project Pełny etat

    **About the Role**We are seeking a highly skilled Big Data Engineer to join our team at Promote Project. The successful candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on cloud projects for large-scale data processing and analytics.As a key member of our data engineering squad, you will work...


  • Kraków, Lesser Poland Alliance-TK Pełny etat

    Hybrid, Monday-Wednesday in the office in KrakowRequirements3+ years of experience in backend or data engineering roles.Proficiency in programming languages such as Python, Java, or Scala.Strong experience with big data technologies like Spark, Hadoop, or Kafka.Seniority levelMid-Senior levelEmployment typeFull-timeJob functionEngineering and Information...


  • Kraków, Lesser Poland HSBC Technology Poland Pełny etat

    Your career opportunity The Lead Cybersecurity Data Acquisition Engineer role will work closely with Principal engineers within the Platform & Data Engineering Team, contributing to and coordinating data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking...