Big Data Engineer

2 dni temu

Warsaw, Polska myGwork Pełny etat
Job Title: Big Data Engineer

We are seeking a skilled Big Data Engineer to join our team at Capco Poland. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on on-prem, migration, and cloud projects for large-scale data processing and analytics.

Key Responsibilities:
  • Design and develop robust data pipelines using Scala, Spark, Hadoop, and SQL for batch and streaming data processing.
  • Collaborate with cross-functional teams to understand data requirements and design efficient solutions that meet business needs.
  • Optimize Spark jobs and data processing workflows for performance, scalability, and reliability.
  • Ensure data quality, integrity, and security throughout the data lifecycle.
  • Troubleshoot and resolve data pipeline issues in a timely manner to minimize downtime and impact on business operations.
  • Stay updated on industry best practices, emerging technologies, and trends in big data processing and analytics.
  • Document, design specifications, deployment procedures, and operational guidelines for data pipelines and systems.
  • Provide technical guidance and mentorship for new joiners.
Requirements:
  • Minimum 3-4 years of experience as a Data Engineer/Big Data Engineer.
  • University degree in computer science, mathematics, natural sciences, or similar field and relevant working experience.
  • Excellent SQL skills, including advanced concepts.
  • Very good programming skills in Scala.
  • Experience in Spark and Hadoop.
  • Experience in OOP.
  • Experience using agile frameworks like Scrum.
  • Interest in financial services and markets.
  • Nice to have: experience or knowledge with GCP.
  • Fluent English communication and presentation skills.
  • Sense of humor and positive attitude.
Why Join Capco?
  • Employment contract and/or Business to Business - whichever you prefer.
  • Possibility to work remotely.
  • Speaking English on a daily basis, mainly in contact with foreign stakeholders and peers.
  • Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance).
  • Access to 3,000+ Business Courses Platform (Udemy).
  • Access to required IT equipment.
  • Paid Referral Program.
  • Participation in charity events, e.g., Szlachetna Paczka.
  • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise.
  • Being part of the core squad focused on the growth of the Polish business unit.
  • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients.
  • A work culture focused on innovation and creating lasting value for our clients and employees.

  • Big Data Engineer Scala

    2 dni temu

    Warsaw, Polska Capco Poland Pełny etat

    Job Title: Big Data Engineer ScalaWe are seeking a skilled Big Data Engineer with expertise in Scala to join our team at Capco Poland.Job Description:As a Big Data Engineer with Scala, you will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on on-prem, migration, and cloud projects for large-scale data...

  • Senior Big Data Engineer

    1 miesiąc temu

    Warsaw, Polska ITP IT PERFORMANCE sp. z o.o. Pełny etat

    technologies-expected : Scala Microsoft SQL Server Spark Hadoop Microsoft Azure technologies-optional : Microsoft Power BI about-project : Poszukujemy kandydatów na stanowisko Senior Big Data Engineer. Praca jest dedykowana dla międzynarodowego przedsiębiorstwa finansowego. responsibilities : Opracowywanie wydajnych rozwiązań Big Data Udział przy...

  • Senior Big Data Engineer @ ITDS

    10 godzin temu

    Warsaw, Polska ITDS Pełny etat

    Join Us and Accelerate Your Big Data Career! Warsaw-based opportunity to work in hybrid model! As a  Senior Big Data Engineer , you will join our Client, a leading global provider of advanced analytics, innovative technology solutions and unique clinical research services to the life sciences industry. You will be working collaboratively with the team to...

  • Senior Big Data Engineer

    1 tydzień temu

    Warsaw, Polska ITDS Polska Sp. z o.o. Pełny etat

    technologies-expected : Scala Apache Spark SQL Microsoft Azure Apache Kafka Apache Flink HDFS NoSQL Hive HBase Cassandra ElasticSearch about-project : As a Senior Big Data Engineer, you will join our Client, a leading global provider of advanced analytics, innovative technology solutions and unique clinical research services to the life sciences industry....

  • Senior Big Data Engineer

    5 miesięcy temu

    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Mid Big Data Engineer

    6 dni temu

    Warsaw, Polska myGwork Pełny etat

    This job is with Capco, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. CAPCO POLAND *We are looking for Poland based candidate. The job is remote but may require some business trips. Joining Capco means joining an organisation that is committed to...

  • Senior Data Engineer to work with Big Data

    2 miesięcy temu

    Warsaw, Polska Nordea Bank Pełny etat

    Job ID: 25161  #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...

  • Senior Data Engineer to work with Big Data

    4 miesięcy temu

    Warsaw, Polska Nordea Bank Pełny etat

    Job ID: 25161  #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...

  • Hadoop/Big Data Site Reliability Engineer

    5 miesięcy temu

    Warsaw, Polska VISA Pełny etat

    Job Description And Responsibilities Staff Site Reliability Engineer - Product Reliability Engineering   Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second...

  • Data Engineer

    3 miesięcy temu

    Warsaw, Polska release11 Pełny etat

    Dołącz do nas jako Data Engineer (Kafka) i pracuj w skandynawskiej firmie z branży edukacyjnej, która realnie wpływa na naukę dzieci i młodzieży!Co tu znajdzieszKontrakt: umowa B2B;Lokalizacja: 100% praca zdalna na zawsze;Sprzęt: Linux lub Windows - Ty wybierasz (możesz też pracować na własnym sprzęcie);Skandynawskie podejście do pracy:...

  • Data Engineer

    1 dzień temu

    Warsaw, Polska Develocraft sp. z o.o. Pełny etat

    technologies-expected : Python PySpark Airflow Kedro SQL NoSQL Docker Kubernetes about-project : Develocraft is looking for a Data Engineer for one of our international clients, which operates in several different areas. Among its many tasks are the provision of IT security services, Big Data, risk management, cloud services, broad process automation, and...

  • Data Engineer

    1 miesiąc temu

    Warsaw, Polska NEONTRI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ SPÓŁKA KOMANDYTOWA Pełny etat

    technologies-expected : Hadoop Spark Hive Scala Java technologies-optional : Python ML/AI about-project : Currently, for our Client: the world leader in digital payments, we are looking for a Data Engineer. responsibilities : Working on corporate applications Building and maintaining a data engineering process Executing data engineering...

  • Data Engineer

    3 tygodni temu

    Warsaw, Polska Team Connect Sp. z o.o. Pełny etat

    technologies-expected : SQL Spark Hadoop Scala technologies-optional : Google Cloud Platform Big Query Kafka Juniper Apache Hive about-project : Do współpracy z naszym Klientem z branży bankowej poszukujemy Data Engineera. Lokalizacja: praca zdalna z 1 wizytą na kwartał w biurze w Krakowie Forma współpracy: B2B 140 -155 PLN...

  • Data Engineer

    2 dni temu

    Warsaw, Polska myGwork Pełny etat

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team in Warsaw. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.Key Responsibilities:Develop and implement data pipelines and architectures to support business intelligence and analyticsDesign and...

  • Data Engineer

    2 tygodni temu

    Warsaw, Polska Procter & Gamble Pełny etat

    Job Location Warsaw Job Description Data Engineer lead or contribute to the data design for Anaplan solution, helping to define how data will flow, and be stored and structured. Among other things, Data Engineer will:  collaborate with business partners and Product Owner to elicit and understand data requirements and relevant principles and...

  • Big Data Developer

    1 miesiąc temu

    Warsaw, Polska emagine sp. z o.o. Pełny etat

    technologies-expected : Scala Java Apache Spark YARN MR Sqoop Apache Hive Kafka Impala Jenkins Bamboo Jira Bitbucket Git Stash about-project : Industry: Banking Location: Remote / Warsaw ( one day per week) Rate: up to 170 PLN/h Start: ASAP Project duration: long term Required languages: English responsibilities : This data-driven initiative supports group...

  • Senior Data Engineer

    2 dni temu

    Warsaw, Polska ITDS Polska Sp. z o.o. Pełny etat

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at ITDS Polska Sp. z o.o. in Warsaw. As a Senior Big Data Engineer, you will play a key role in designing, developing, and supporting data engineering solutions that help solve complex business challenges in the healthcare industry.Key ResponsibilitiesDesign and develop...

  • AI/ML Engineer @ PAR Data Central

    2 tygodni temu

    Warsaw, Polska PAR Data Central Pełny etat

    To deliver solutions that connect people to the restaurants, meals, and moments they love. We take that responsibility very seriously. As a leading restaurant technology provider to the world’s top restaurant brands, we’re calling all rebels, instigators, idealists, and builders to join our constantly growing team. If you’ve excelled at every...

  • Data Engineer

    2 dni temu

    Warsaw, Polska Procter & Gamble Pełny etat

    Job Title: Data EngineerProcter & Gamble is seeking a highly skilled Data Engineer to lead or contribute to the data design for our Anaplan solution. As a Data Engineer, you will help define how data will flow, be stored, and structured.Key Responsibilities:Collaborate with business partners and Product Owner to elicit and understand data requirements and...

  • Data Engineer

    4 miesięcy temu

    Warsaw, Polska Sanoma Pełny etat

    100% remote opportunity for candidates based in PolandSanoma Learning is the leading European learning company, serving over 20 million students in 11 countries. We offer printed and digital learning materials as well as digital learning and teaching platforms for primary, secondary, and vocational education. The development of our methodologies is based on...