Data Engineer with Expertise in Groovy and Spark

2 miesięcy temu

Kraków, Lesser Poland DataArt Pełny etat

Key Responsibilities

  • Collaborate with data engineers, product teams, and stakeholders to gather data requirements and design efficient data pipelines.
  • Develop and maintain algorithms and data processing code in Java/Groovy.
  • Implement data validation, cleansing, and transformation processes to ensure data accuracy and consistency.
  • Automate data extraction from various sources using Python scripts.
  • Monitor and troubleshoot data pipeline performance in Airflow, addressing any issues or bottlenecks.
  • Extract data from BigQuery using SQL queries and develop reports with Google's Looker Studio.
  • Participate in daily stand-ups, sprint planning, and retrospective meetings.
  • Engage in peer code reviews, knowledge sharing, and assist colleagues with their work.
  • Introduce new technologies and best practices to keep the product up to date.
  • Assist in troubleshooting and resolving production escalations and issues.

Requirements

  • Bachelor's degree or equivalent programming experience.
  • 4-5 years of overall experience as a backend software developer, with at least 2 years as a Data Engineer using Spark with Java/Groovy and/or Python.
  • Strong coding skills and knowledge of data structures, OOP principles, databases, and API design.
  • Highly proficient in developing programs and data pipelines in Java/Groovy or Python.
  • 2+ years of professional experience with Apache Spark/Hadoop.

Nice to Have

  • Work experience with AWS (EMR, S3, lambda, EC2, glue, RDS).
  • Work experience with SQL (MYSQL is a Plus) and NoSQL Databases.
  • Experience with Elasticsearch.
  • Experience with Python.
  • Experience with Scala (Zeppelin).
  • Experience with Airflow or other ETL.
  • Certification or verified training in one or more of the following technologies/products: AWS, ElasticSearch.

  • Senior Data Engineer with Expertise in Java and Spark

    1 miesiąc temu

    Kraków, Lesser Poland DataArt Pełny etat

    Job SummaryWe are looking for a highly skilled Data Engineer to join our team at DataArt.ResponsibilitiesCollaborate with data engineers, product teams, and stakeholders to design and build efficient data pipelines.

  • Big Data Engineer: Scalable Data Solutions

    2 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Job DescriptionWe are seeking an experienced Big Data Engineer to join our team at Daxx. As a key member of our digital product company, you will be responsible for designing and developing scalable data solutions using Scala, Hadoop, and Spark technologies.Key ResponsibilitiesDesign and Develop Big Data Solutions: Architect, design, and implement scalable...

  • Data Engineer and Analyst

    2 dni temu

    Kraków, Lesser Poland Sii Sp. Z O.o. Pełny etat

    Company Overview: Sii Sp. Z O.o. is a dedicated team of experts passionate about data analysis, processing, and management. We create innovative solutions in areas like Data Science, Big Data, Machine Learning, and Data Engineering.About the Job: As a Data Engineer and Analyst, you will be responsible for analyzing and verifying data from different sources...

  • Data Engineer Expertise in Banking Data Solutions

    3 tygodni temu

    Kraków, Lesser Poland emagine Consulting Pełny etat

    Emagine Consulting: Exciting Career OpportunitiesWe are seeking a skilled Data Engineer to join our team and contribute to the development of innovative data solutions in the banking industry.The ideal candidate will have advanced SQL skills, experience with GCP (Google Cloud Platform), and proficiency in ETL Pipelines, Data Modelling, CI/CD Tools, Data...

  • Senior Java/Groovy DevOps Engineer

    4 tygodni temu

    Kraków, Lesser Poland Infotree Global Solutions Pełny etat

    Job DescriptionWe are looking for an experienced DevOps Engineer to join our team at Infotree Global Solutions. The ideal candidate will have a passion for designing, developing, and maintaining Continuous Integration pipelines for Java applications used to configure public safety network elements.The successful candidate will be responsible for:Designing...

  • Cloud-Based Data Engineer

    3 tygodni temu

    Kraków, Lesser Poland William Hill Pełny etat

    We are a world-class technology company at the forefront of innovation, shaping the future of our industry with cutting-edge systems that deliver exceptional performance. As a Cloud-Based Data Engineer, you will play a key role in building our Big Data platform, enabling machine learning, and advanced analytics on a cloud-based infrastructure for scalability...

  • Big Data Architect

    4 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Unlock Your Potential as a Cloud Big Data Engineer at DaxxWe are seeking an experienced Cloud Big Data Engineer to join our team at Daxx, a leading digital transformation consulting and implementation services provider. As a key member of our engineering team, you will have the opportunity to work on cutting-edge projects that drive innovation and growth for...

  • Cloud Data Engineer for Cutting-Edge Platforms

    4 tygodni temu

    Kraków, Lesser Poland William Hill Pełny etat

    Job Description:We are seeking a highly skilled Cloud Data Engineer to join our team in building cutting-edge data platforms. As a key member of our engineering team, you will be responsible for designing and implementing scalable, high-performance data systems using cloud-based technologies.About Us:Grand Parade is a leading technology company that provides...

  • Software Architect with Expertise in Scala and Distributed Systems

    3 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Senior Scala EngineerAt Grid Dynamics, we are seeking a seasoned Senior Scala Engineer to join our team. As a key member of our engineering group, you will play a crucial role in the design, development, and deployment of cutting-edge technological solutions for our clients.Key Responsibilities:Design and implement scalable, modular, and efficient software...

  • Software Architect with FinTech Expertise

    3 tygodni temu

    Kraków, Lesser Poland Twelve Data Pełny etat

    Job OverviewWe are seeking a highly skilled Software Architect to join our Backend team at Twelve Data. The ideal candidate will have a passion for creating impactful FinTech products and experience developing stable systems that process large amounts of financial data.This is a full-time position, offering a competitive salary of $120,000 per year,...

  • Cloud Engineer

    3 tygodni temu

    Kraków, Lesser Poland Epam Pełny etat

    Job DescriptionWe are seeking a Cloud Engineer to join our joint project team and contribute to the development of a centralized Master Data repository of Client Profiles and their marketing preferences.Data will be sourced from multiple upstream systems, processed using ETL, and distributed to multiple downstream systems. Our project utilizes a technology...

  • Data Science Engineer with Advanced Analytics Expertise

    4 tygodni temu

    Kraków, Lesser Poland Sabre Pełny etat

    Company OverviewSabre is a leading technology company in the travel industry, utilizing next-generation solutions to drive innovation and growth.Job DescriptionWe are seeking a highly skilled Data Science Engineer to join our team. In this role, you will apply advanced analytics expertise to strategic and operational problems, leveraging statistical...

  • Cloud Computing Specialist with Expertise in Data Engineering

    4 tygodni temu

    Kraków, Lesser Poland GFT Technologies SE Pełny etat

    Why Choose GFT?You'll be part of a team that values expertise and learning. With 60% of our employees at senior levels, you'll have ample opportunities to grow and develop your skills.About the RoleThis position involves working with cloud technologies, and we provide comprehensive support for your professional growth through training programs,...

  • Lead Big Data Solutions Architect for Financial Services

    4 tygodni temu

    Kraków, Lesser Poland Capco Poland Pełny etat

    About the RoleWe are seeking a highly skilled Lead Big Data Solutions Architect to join our team at Capco Poland. The ideal candidate will have extensive experience in designing and implementing scalable data pipelines and solutions on-prem, migration, and cloud projects for large-scale data processing and analytics.ResponsibilitiesDesign, develop, and...

  • Software Engineering Expert in Java and Data Systems

    3 tygodni temu

    Kraków, Lesser Poland Reality Games Pełny etat

    Company OverviewReality Games is an international company that develops innovative technology solutions for the gaming industry.SalaryThe estimated salary for this role is $120,000 per year.Job DescriptionWe are looking for a skilled Java Backend Developer to join our team of software engineers.This is an exciting opportunity to work on geographically...

  • Data Infrastructure Specialist

    5 dni temu

    Kraków, Lesser Poland ITDS Polska Sp. Z O.o. Pełny etat

    We are seeking a skilled Data Engineer to contribute to the development of scalable data infrastructures and pipelines. As a key member of our team, you will empower AI/ML models, analytics, and data-driven applications while enhancing data governance practices.This is a hybrid opportunity based in Cracow, with 2-3 days per week working from home. You will...

  • Senior Cloud DevOps Engineer Position in Krakow

    10 godzin temu

    Kraków, Lesser Poland Mindbox S.A. Pełny etat

    Cloud Development Engineer Role OverviewWe are seeking an experienced Cloud DevOps Engineer to join our team at Mindbox S.A., specifically within the Enterprise Technology department focused on Governance, Risk, and Compliance.Governance, Risk, and Compliance play a critical role in managing Operational & Resilience Risk and Model Risk Management within...

  • Data Scientist with Expertise in AI Model Optimization

    3 tygodni temu

    Kraków, Lesser Poland Ibm Polska Sp. z o.o. Pełny etat

    Data Scientist60000 - 120000 PLN per yearJobs OverviewWe are seeking a highly skilled Data Scientist to join our team at IBM Polska Sp. z o.o.Job ResponsibilitiesInvestigate and experiment with new model architectures to improve existing machine learning models, training pipelines, and run-time inference performanceCreatively balance the demands of...

  • Cloud Engineer with Python and Azure

    4 tygodni temu

    Kraków, Lesser Poland Epam Pełny etat

    About the Role We are seeking a highly skilled Cloud Engineer with expertise in Python and Azure to join our team. The ideal candidate will have experience in cloud-based technologies, particularly Azure Databricks and Data Factory, and possess a solid understanding of backend automation, database testing, and ETL processes. As a key member of our...

  • Software Engineer with Expertise in Fullstack Node.js

    4 tygodni temu

    Kraków, Lesser Poland TechWings Pełny etat

    At TechWings, we are seeking a skilled Software Engineer to join our international team of professionals.As a Fullstack Node.js Developer, you will work on complex client-server solutions and contribute to the success of our projects in the EdTech, InsurTech, AdTech, and other sectors.This role offers a unique opportunity to collaborate with clients, analyze...