Data Engineer

2 tygodni temu

Warszawa, Mazovia, Polska Link Group Pełny etat

We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have hands-on experience with Python and SQL to develop and maintain data processing workflows, ensuring data integrity, performance, and security.

This role involves building integrations with both external APIs and internal systems, managing data storage solutions such as data warehouses and relational databases, and conducting data quality checks. The candidate will collaborate closely with data scientists and IT teams to ensure seamless and secure integration of data infrastructure within the organization.

Project Description

The project focuses on developing and optimizing data pipelines to support business intelligence, analytics, and machine learning initiatives. The Data Engineer will be responsible for integrating data from various sources, ensuring data consistency, and maintaining high-performance storage solutions.

The role requires collaboration with data scientists and IT teams to align data architecture with business objectives while maintaining security and compliance standards. Additionally, the engineer will monitor system performance, troubleshoot issues, and contribute to the automation and scalability of data workflows.

This is an excellent opportunity to work with cutting-edge data technologies in a dynamic environment, contributing to data-driven decision-making and business transformation.

Key Responsibilities

  • Design, develop, and maintain ETL data pipelines using Python and SQL.
  • Implement and manage data storage solutions, including relational databases and data warehouses.
  • Build integrations with external APIs and internal systems to enable efficient data exchange.
  • Perform data analysis and quality checks, ensuring data accuracy and reliability.
  • Monitor data infrastructure to optimize performance, security, and scalability.
  • Work closely with data scientists and IT teams to align data workflows with business needs.

Skills & Qualifications

  • 3+ years of experience developing ETL processing pipelines using Python and SQL.
  • Strong data modeling and database management skills, particularly with relational databases (preferably PostgreSQL).
  • Proficiency in Linux environments (especially RedHat distributions) and version control systems (Git).
  • Familiarity with DevOps pipelines, particularly Azure DevOps Services.
  • Understanding of containerization technologies like Docker or Podman.
  • Strong problem-solving skills and willingness to learn new technologies.

Nice to Have

  • Experience with Apache Airflow or other data orchestration tools.
  • Familiarity with Databricks, Dataiku, MLflow, or similar Machine Learning platforms.
  • Knowledge of kdb+/q and distributed processing frameworks like Hadoop and Spark/PySpark.
  • Understanding of financial markets, especially fixed income instruments.

  • Data Engineer Role

    4 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing complex data systems, working closely with the Data Science team to deliver machine learning models into production environments.You will have experience with distributed technologies, including Hadoop,...

  • Experienced Data Engineer Wanted

    3 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The successful candidate will have a strong understanding of data structures and algorithms, experience with Spark Jobs, and knowledge of cloud technologies.As a Data Engineer, you will be responsible for designing and implementing complex data systems,...

  • Data Engineer Position

    2 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the Company: Data Science UA is a leading service company with a strong focus on data science and artificial intelligence expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, laying the foundation for our growth over the past eight years. We have fostered the largest Data Science Community in Eastern...

  • Senior Data Engineer @

    1 tydzień temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...

  • Senior Data Engineer Position

    4 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth.Our client is the market-leading intelligence platform for paid search advertising. The unique combination of artificial search...

  • Senior Data Engineer in Cloud and Big Data Technologies

    5 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About UsData Science UA is a company that specializes in providing data science and AI services to its clients. Our mission is to help businesses make informed decisions by leveraging the power of data and artificial intelligence. With a strong focus on innovation and customer satisfaction, we strive to be the go-to partner for organizations seeking to...

  • Experienced Data Engineer Wanted for Dynamic Team

    5 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    Job OverviewData Science UA is a leading provider of data science and AI services. We are looking for a skilled Data Engineer to join our team and contribute to delivering innovative solutions for our clients. The ideal candidate will have commercial experience in developing Spark Jobs using Scala and Java, as well as experience in data processing using...

  • Data Engineer for Intelligent Advertising Solutions

    6 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began with organizing the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have fostered the largest Data Science Community in Eastern Europe.We work with market-leading intelligence platforms for paid...

  • Senior Data Scientist Role

    2 dni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    Job Overview: Data Science UA is looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will have commercial experience developing Spark Jobs using Scala and Java, and experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3) and designing data models and data warehouses. Strong...

  • Expert Big Data Developer

    1 dzień temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About Us: Data Science UA is a service company with a strong focus on data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, which laid the foundation for our growth over the past eight years. We have fostered the largest Data Science Community in Eastern Europe. Our client is a market-leading...

  • Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join our Site Service Data & Insights (SSDI) DataOne project. The role involves ingesting data from source systems using technologies such as Python and Talend, modeling data following the Data Vault methodology.Data Engineer - BI Reporting with Tableau / ThoughtspotYour responsibilitiesData Engineering &...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Vwfs Pełny etat

    Join to apply for the Data Engineer (with SAP BW/4HANA) role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska VW FS Pełny etat

    Join to apply for the Data Engineer role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently...

  • Advanced Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Software Engineer-Machine Learning Engineer/Data Engineer to join our team.Key Responsibilities:Develop and maintain ETL/ELT pipelines using Python and SQLWork with Hadoop, Spark, and Big Data technologies for large-scale data processingDesign, train, test, and deploy ML models using Python...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska AIDA Recruitment Pełny etat

    We are currently looking for a Data Engineer in Poland for our client project, which involves remote full-time involvement.Responsibilities:Develop and manage efficient data pipelines for extracting and transforming data from Dynamics 365 FO.Design data storage and integration solutions that align with analytical and business needs.Optimize data processing...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska ALGOTEQUE Innovation Hub Pełny etat

    About company :ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive,...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Clouds On Mars sp. z o.o Pełny etat

    ResponsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer's sideDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh conceptsWe are looking forStrong Data Design and...

  • Data Platform Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...

  • Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    Data Engineering, AWS, Python, Pyspark and Databricks, Handson Experience in Building Data Pipelines and Transformation for both Batch and Streaming Data. Expertise in AWS Cloud as Data Engineer.Cloud PaaS environment:AWS, Databricks, proficient with the following AWS tools: EMR, EC2, Airflow, AWS Lambda, AWS Step function.Seniority levelMid-Senior...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Newxel Pełny etat

    Are you ready to revolutionize the Sports Tech industry? We're on the hunt for a Data Engineer to join our client's dynamic team in Warsaw. This is your chance to work at the intersection of cutting-edge technology, including AI, ML, and video editing, while shaping the future of sports entertainment. Be part of a team that's Fuelling the Fandom worldwide by...