Data Engineer

4 tygodni temu

Wołodyjowskiego Warszawa, Polska Team Connect Pełny etat

Team Connect is Poland's leading nearshore and offshore IT provider. Since 2008 we successfully create and develop software for our clients.

We are also a proud certified Salesforce Partner. 

We specialize in Agile and DevOps-based software development. From the analysis stage through implementation. We develop backend, frontend, and mobile applications.

Currently, we are looking for: Senior Big Data Engineer

The ideal candidate will be responsible for designing, implementing and maintaining scalable data pipelines and solutions on on-prem / migration / cloud projects for large scale data processing and analytics.

BIG DATA ENGINEER @ CAPCO - WHAT TO EXPECT

  • You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
  • You'll be part of digital engineering team that develop new and enhance existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
  • You'll be involved in digital and data transformation processes through a continuous delivery model.
  • You will work on automating and optimising data engineering processes, develop robust and fault tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
  • You'll be able to work across different data, cloud and messaging technology stacks.
  • You'll have an opportunity to learn and work with specialised data and cloud technologies to widen the skill set. 

THINGS YOU WILL DOWork alongside clients to interpret requirements and define industry-leading solutions

  • Design and develop robust, well tested data pipelines
  • Demonstrate and help clients adhere to best practices in engineering and SDLC
  • Excellent knowledge of building event-driven, loosely coupled distributed applications
  • Experience in developing both on-premise and cloud-based solutions
  • Build and improve strong relationships with peers, senior stakeholders and client
  • Leading and mentoring the team of junior and mid-level engineers
  • Contribute to security designs and have advanced knowledge of key security technologies e.g. TLS, OAuth, Encryption
  • Support internal Capco capabilities by sharing insight, experience and credentials

TECH STACK: Python, OOP, Spark, SQL, Hadoop, GCP

Nice to have: Pub/Sub, Big Query, Kafka, Juniper, Apache NiFi, Hive, Impala, Cloudera, CI/CD

SKILLS & EXPERIENCES YOU NEED TO GET THE JOB DONE

  • Strong cloud provider's experience on GCP
  • Hands on experience using Python. Scala and Java are also nice to have but not fully required.
  • Experience in most or all of data and cloud technologies such as Hadoop, HIVE, Spark, Flume, PySpark, DataProc, Cloudera, Airflow, Oozie, S3, Terraform etc.
  • Hands on experience with schema design using semi-structured and structured data structures
  • Experience using messaging technologies – Kafka, Kafka Connect, Spark Streaming, Amazon Kinesis
  • Strong experience in SQL
  • Good understanding of the differences and tradeoff between SQL and NoSQL, ETL and ELT
  • Understanding of containerisation (Docker, Kubernetes) and orchestration techniques
  • Experience with data lake formation and data warehousing principles and technologies – BigQuery, Redshift, Snowflake
  • Experience using version control tool such as Git.
  • Familiar with development good practices and optimisation techniques.
  • Experience in design, build and maintain CI/CD Pipelines on Jenkins, CircleCI
  • Enthusiasm and ability to pick up new technologies as needed to solve your problems

We offer:

  • Long-term cooperation
  • Benefit package - Multisport, private medical care, life insurance
  • Training budget
  • Free English lessons
  • Individual support from a dedicated company mentor 

  • Senior Data Engineer @

    1 dzień temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...

  • Data Engineer

    4 tygodni temu

    Warszawa, Polska DCV Technologies Pełny etat

    We are looking for a Senior Data Engineer with expertise in DataBricks and Data Engineering to join our team, working with one of the leaders in the automotive industry. The ideal candidate will have a deep understanding of DataBricks, Delta Lake, PySpark, and related technologies.Job Title: Senior Data Engineer - Data BricksLocation: Wipro Warsaw Office...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join our Site Service Data & Insights (SSDI) DataOne project. The role involves ingesting data from source systems using technologies such as Python and Talend, modeling data following the Data Vault methodology.Data Engineer - BI Reporting with Tableau / ThoughtspotYour responsibilitiesData Engineering &...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Vwfs Pełny etat

    Join to apply for the Data Engineer (with SAP BW/4HANA) role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska VW FS Pełny etat

    Join to apply for the Data Engineer role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have hands-on experience with Python and SQL to develop and maintain data processing workflows, ensuring data integrity, performance, and security.This role involves building integrations with both external APIs...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Clouds On Mars sp. z o.o Pełny etat

    ResponsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer's sideDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh conceptsWe are looking forStrong Data Design and...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska ALGOTEQUE Innovation Hub Pełny etat

    About company :ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive,...

  • Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska AIDA Recruitment Pełny etat

    We are currently looking for a Data Engineer in Poland for our client project, which involves remote full-time involvement.Responsibilities:Develop and manage efficient data pipelines for extracting and transforming data from Dynamics 365 FO.Design data storage and integration solutions that align with analytical and business needs.Optimize data processing...

  • Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.

  • Data Platform Engineer @

    3 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are Square One. For 30 years, we have specialized in IT recruitment and understand exactly what IT experts like you need. If you're looking for new challenges, aren't afraid of projects that enhance your skills, and want to stay at the forefront of technology – you're in the right placeWe are looking for a Data Engineer with experience in Big Data or...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Newxel Pełny etat

    Are you ready to revolutionize the Sports Tech industry? We're on the hunt for a Data Engineer to join our client's dynamic team in Warsaw. This is your chance to work at the intersection of cutting-edge technology, including AI, ML, and video editing, while shaping the future of sports entertainment. Be part of a team that's Fuelling the Fandom worldwide by...

  • Data Engineer Lead

    4 dni temu

    Warszawa, Mazovia, Polska Addepto Pełny etat

    At Addepto, we are seeking a highly skilled Senior Data Engineer to join our team of technology experts. As a Senior Data Engineer, you will have the exciting opportunity to work on challenging projects across various industries, leveraging cutting-edge technologies such as BigQuery and Google Cloud Platform.">Main ResponsibilitiesDesign, implement, and...

  • Data Engineer

    2 tygodni temu

    Warszawa, Polska DCG Pełny etat

    As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:‍ DATA ENGINEER...

  • Data Engineer

    3 godzin temu

    Warszawa, Mazovia, Polska Aristocrat Interactive Pełny etat

    Job OverviewAristocrat Interactive is seeking a highly skilled Data Quality Engineer to join its growing team. In this role, you will be responsible for developing and owning automated and manual testing of data pipelines, reports, and data products for customers and internal stakeholders.Key ResponsibilitiesEstablish data quality automation frameworks,...

  • Senior Data Engineer @

    3 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data Engineer We seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Noda Introduces Pełny etat

    Join to apply for the Data Engineer role at Noda.Hi We're on the lookout for a vibrant Data Engineer to join Noda, a licensed UK Payment Institution and the brains behind an innovative Open Banking payments platform. If you're fueled by fintech excitement and seek a global career journey, keep readingWhat is Noda?Noda is reshaping online payments, allowing...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Social network you want to login/join with:You will be a contributor in a new dedicated core data engineering team tasked with developing and owning standard data engineering patterns that BAM's data engineers, analysts, scientists, and quantitative researchers depend on for ingesting and transforming data throughout our ecosystem. This central team is...

  • Senior Data Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data EngineerWe seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...