Data Engineer

2 tygodni temu

Kraków, Polska Link Group Pełny etat

We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have hands-on experience with Python and SQL to develop and maintain data processing workflows, ensuring data integrity, performance, and security.

This role involves building integrations with both external APIs and internal systems, managing data storage solutions such as data warehouses and relational databases, and conducting data quality checks. The candidate will collaborate closely with data scientists and IT teams to ensure seamless and secure integration of data infrastructure within the organization.

Project Description

The project focuses on developing and optimizing data pipelines to support business intelligence, analytics, and machine learning initiatives. The Data Engineer will be responsible for integrating data from various sources, ensuring data consistency, and maintaining high-performance storage solutions.

The role requires collaboration with data scientists and IT teams to align data architecture with business objectives while maintaining security and compliance standards. Additionally, the engineer will monitor system performance, troubleshoot issues, and contribute to the automation and scalability of data workflows.

This is an excellent opportunity to work with cutting-edge data technologies in a dynamic environment, contributing to data-driven decision-making and business transformation.

Key Responsibilities

  • Design, develop, and maintain ETL data pipelines using Python and SQL.
  • Implement and manage data storage solutions, including relational databases and data warehouses.
  • Build integrations with external APIs and internal systems to enable efficient data exchange.
  • Perform data analysis and quality checks, ensuring data accuracy and reliability.
  • Monitor data infrastructure to optimize performance, security, and scalability.
  • Work closely with data scientists and IT teams to align data workflows with business needs.

Skills & Qualifications

  • 3+ years of experience developing ETL processing pipelines using Python and SQL.
  • Strong data modeling and database management skills, particularly with relational databases (preferably PostgreSQL).
  • Proficiency in Linux environments (especially RedHat distributions) and version control systems (Git).
  • Familiarity with DevOps pipelines, particularly Azure DevOps Services.
  • Understanding of containerization technologies like Docker or Podman.
  • Strong problem-solving skills and willingness to learn new technologies.

Nice to Have

  • Experience with Apache Airflow or other data orchestration tools.
  • Familiarity with Databricks, Dataiku, MLflow, or similar Machine Learning platforms.
  • Knowledge of kdb+/q and distributed processing frameworks like Hadoop and Spark/PySpark.
  • Understanding of financial markets, especially fixed income instruments.

  • Data Engineer

    3 dni temu

    Kraków, Lesser Poland TN Poland Pełny etat

    Social network you want to login/join with:Client:Link GroupLocation:Job Category:OtherEU work permit required:YesJob Reference:35077144a5e7Job Views:2Posted:22.04.2025Expiry Date:06.06.2025Job Description:We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have...

  • Data Engineer

    3 tygodni temu

    Kraków, Lesser Poland Pertemps ERP Pełny etat

    Location: Remote/Hybrid (Flexible)FreelanceExperience Level: Intermediate (3-5 years)Job Description:We are seeking a highly skilled and motivated Data Engineer to join our team. This role involves designing, developing, and maintaining cutting-edge data solutions while working collaboratively in an innovative, results-driven environment. If you are...

  • Data Engineer

    3 tygodni temu

    Kraków, Lesser Poland Ampstek Pełny etat

    Big Data Lead Engineer – Krakow, Poland (Hybrid, 3 Days Onsite)Join us in shaping the future of dataWe're on the lookout for a Big Data Lead Engineer to drive innovation, build scalable data pipelines, and transform raw data into meaningful insights. If you thrive in a fast-paced environment, love problem-solving, and have a passion for cloud-based data...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Pertemps ERP Pełny etat

    Location: Remote/Hybrid (Flexible)FreelanceExperience Level: Intermediate (3-5 years)Job Description:We are seeking a highly skilled and motivated Data Engineer to join our team. This role involves designing, developing, and maintaining cutting-edge data solutions while working collaboratively in an innovative, results-driven environment. If you are...

  • Lead Data Engineer @

    3 tygodni temu

    Kraków, Lesser Poland Elitmind Pełny etat

    Join our Team as   Lead Data Engineer   Lead Data Engineer will responsible for developing and maintaining data and reporting platforms and lead our team of Data Engineers through challenges. This key role embraces overseeing the entire engineering lifecycle and ensuring successful data platform implementation. The ideal candidate will d rive competency...

  • Data Engineer

    3 tygodni temu

    Kraków, Polska Kolomolo Pełny etat

    Job Vacancy: Data Engineer Location: Poland - remote / office (Kraków) Contract: B2B, Full-TimeCompany Overview:Kolomolo is a globally recognized tech enterprise dedicated to delivering state-of-the-art digital solutions. As we expand our operations, we are on the lookout for seasoned Data EngineerQualifications:Passion for Data, people, and technologyAt...

  • Big Data Engineer

    3 dni temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Our team is looking for a skilled Data Engineer to join our dynamic group. As a Data Engineer, you will work on engaging projects with some of the largest banks in the world, developing and maintaining data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Google Cloud Storage (GCS), and DataProc.Key Responsibilities:Design, implement,...

  • Data Engineer

    1 tydzień temu

    Kraków, Lesser Poland Luxoft Poland Pełny etat

    Luxoft Poland is a global leader in digital strategy and solutions. We are committed to delivering cutting-edge technology solutions that help our clients make informed decisions with data.About the RoleWe are seeking a skilled Full Stack Engineer to join our Data Migration Tollgate Tracker (DMTT) team in Poland. As a key member of this team, you will be...

  • Data Architecture Engineer

    17 godzin temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Job Title: Data Architecture EngineerJob SummaryWe are seeking a highly experienced Data Architecture Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining our data architecture and ensuring that it meets the needs of our business.The ideal candidate will have a deep understanding of data...

  • Data Engineer Leader

    3 dni temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    About the RoleWe are seeking an experienced Data Engineer to lead our team in building and maintaining an internal data repository. This role will involve partnering with our Product Team to identify core data requirements, analyzing and organizing raw data from different sources, and creating optimal data pipeline architecture.

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Job DescriptionWe are seeking a skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining end-to-end data pipelines for data ingestion, integration, and testing in the cloud.

  • Data Engineer

    7 minut temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Job SummaryWe are seeking an experienced Data Engineer/ETL Developer to support the development and maintenance of advanced data processing solutions.Key ResponsibilitiesBuilding scalable and efficient ETL pipelinesOptimizing data processing workflowsIntegrating with cloud platformsRequirementsA strong background in modern data warehousing is essential,...

  • Data Engineer Expert

    1 tydzień temu

    Kraków, Polska Kolomolo Pełny etat

    As a pioneer in data innovation, we are seeking a seasoned Data Engineer to join our dynamic team at Kolomolo. With a strong background in cloud technologies and data platforms, you will play a crucial role in shaping our digital solutions.Company OverviewKolomolo is a globally recognized tech enterprise dedicated to delivering cutting-edge digital...

  • Cybersecurity Data Engineer

    1 tydzień temu

    Kraków, Lesser Poland HSBC Service Delivery Sp. z o.o. Pełny etat

    Job DescriptionThe Lead Cybersecurity Data Acquisition Engineer role plays a crucial part in our Platform & Data Engineering Team, collaborating closely with Principal engineers to enhance data engineering, data acquisition, cloud infrastructure, and platform operations. Key responsibilities include ingesting and provisioning raw datasets, enriched tables,...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Numlabs Pełny etat

    Job Description:We are looking for an experienced Data Engineer / ETL Developer to join our team and support the development and maintenance of advanced data processing solutions. Your responsibilities will include building scalable and efficient ETL pipelines, optimizing data processing workflows, and integrating with cloud platforms. If you have a strong...

  • Data Engineer

    5 dni temu

    Kraków, Lesser Poland Alfa Laval Pełny etat

    Every day, we get opportunities to make a positive impact – on our colleagues, partners, customers and society. Together, we're pioneering the solutions of the future and unlocking the full potential of precious resources. Trusted to act on initiative, we challenge conventional thinking to develop world-leading technologies that inspire progress in vital...

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Senior Data Engineer Job SummaryWe are seeking an experienced Senior Data Engineer to join our team. As a key member of our Analytics & Insights team, you will be responsible for designing and implementing data transformation pipelines, data marts, ETL processes, and more. Your expertise in SQL development, GCP, Big Query, DBT, Airflow, Cloud Composer, data...

  • Data Engineer for Innovative Data Projects

    2 tygodni temu

    Kraków, Lesser Poland Addepto Pełny etat

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team at Addepto, a leading consulting and technology company specializing in AI and Big Data. As a Senior Data Engineer, you will have the opportunity to work on challenging projects across various industries, leveraging cutting-edge technologies like BigQuery, Looker, SQL, and...

  • Data Engineer

    3 dni temu

    Kraków, Lesser Poland TN Poland Pełny etat

    Data Engineer (Pyspark or Scala)Contract Type: B2BWorkload: Full-timeAre you looking to make a real impact in a global financial project? We are seeking a Data Engineer to join our client's team. Their strategy focuses on protecting data through robust management policies, engaging colleagues with enhanced training opportunities, and building sustainable...

  • Cloud Data Engineer

    55 minut temu

    Kraków, Lesser Poland beBee Careers Pełny etat

    Job OverviewWe are looking for an experienced Machine Learning Engineer to join our team. As a Mid-level engineer, you will be responsible for designing and implementing data pipelines to support AI/ML models. This role requires strong technical skills and the ability to collaborate with stakeholders.Main Tasks:Building data acquisition and processing...