Senior Data Engineer – Python Spark AWS

2 dni temu

Warsaw, Polska Link Group Pełny etat

Senior Data Engineer – Python, Spark, AWS We're looking for a Senior Data Engineer to join a highly skilled team responsible for building a scalable, multitenant data platform that powers data ingestion, transformation, cataloging, and distribution for internal and external stakeholders. This role is central to designing robust data pipelines, integrating modern data lakehouse components, and supporting the company's AWS-based infrastructure. What You'll Do: Design and build scalable data ingestion pipelines in AWS Work extensively with Databricks, including Unity Catalog, streaming, Delta Lake, and data transformation tools Lead technical delivery and implementation of core platform components across raw, normalized, operational, and historical layers Collaborate with engineering managers and cross-functional teams across the US and Poland Drive technical excellence by improving team processes, architecture standards, and engineering best practices Support and consult with stakeholders to ensure successful delivery of data-driven solutions Contribute to the growth and maturity of the team's cloud and data engineering capabilities What We're Looking For: 5 years of experience in Python and strong software engineering skills Solid knowledge of AWS cloud services and best practices Experience building scalable Spark pipelines in PySpark or Scala Practical experience with Spark Streaming for low-latency pipelines Familiarity with Delta Lake and modern data lakehouse architectures Hands-on experience with Kubernetes and container orchestration Experience with MongoDB and other NoSQL data stores Understanding of microservices and event-driven architecture Excellent communication skills and ability to work in a collaborative, global team Commitment to high standards of ethics, quality, and delivery Nice to Have: Familiarity with Machine Learning, AI models, or Data Science workflows

  • Senior AWS BI Data Engineer

    3 tygodni temu

    Warsaw, Polska Be in IT Pełny etat

    Senior AWS BI Data Engineer Miejsce pracy: Warszawa Technologie, których używamy Wymagane AWS Python SQL Amazon QuickSight Microsoft Power BI Tableau Git System operacyjny Windows Linux O projekcie Długofalowa współpraca z międzynarodową, topową firmą consultingową, świadcząca usługi IT dla dużych i średnich firm z różnorodnych sektorów jak...

  • Senior AWS Data Engineer

    2 tygodni temu

    Warsaw, Polska Cyclad Pełny etat

    technologies-expected : - Glue - Redshift - Lambda - Athena - S3 - Snowflake - Docker - Terraform - CloudFormation - Kafka - Airflow - Spark - Python - Scala - Java - Bash - AWS technologies-optional : - Airflow - Prefect - Kafka - Spark Streaming - Snowflake - Databricks about-project : - In Cyclad we work wih top international IT companies in order to...

  • Senior Data AWS Engineer

    2 dni temu

    Warsaw, Polska Bayer Sp. z o.o. Pełny etat

    For Digital Hub Warsaw, we are looking for: Senior Data AWS Engineer Participate in a global, strategic project in the Bayer Consumer Health division that will influence data in our business and manufacturing processes going forward. Our AWS-based data platform aggregates information from various sources to promote efficiency, creativity and better...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska INNOBO sp. z o.o. Pełny etat

    technologies-expected : - Python - Spark - AWS - TensorFlow - PyTorch - SQL - Hive SQL - BitBucket - Git about-project : - Client: banking industry - Hourly Rate: up to 160 PLN + VAT - Location: Gdansk or Gdynia or Warsaw or Lodz, Poland - Work arrangement: hybrid, 2 days at the office, full-time - For our Client from banking industry we are looking for...

  • AWS Data Engineer

    3 tygodni temu

    Warsaw, Polska Experis Manpower Group Pełny etat

    Location: 100% remote (Poland) Start Date : ASAP / within 1 month Description We are looking for an experienced AWS Data Engineer with a strong background in designing and implementing cloud-based data solutions. This role involves working on large-scale and unstructured datasets, optimizing data workflows, and collaborating with cross-functional teams to...

  • Senior Data Engineer Spark

    3 tygodni temu

    Warsaw, Polska Opensignal Pełny etat

    What you will be doing Own and improve our big data pipelines in AWS Spark. Assemble large, complex data sets that meet business requirements, with engineering best practices in mind. Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers. Work closely with our data scientists and...

  • Senior AWS Data Engineer

    2 tygodni temu

    Warsaw, Polska Cyclad Pełny etat

    Senior AWS Data Engineer Miejsce pracy: Warszawa Technologies we use Expected - Glue - Redshift - Lambda - Athena - S3 - Snowflake - Docker - Terraform - CloudFormation - Kafka - Airflow - Spark - Python - Scala - Java - Bash - AWS Optional - Airflow - Prefect - Kafka - Spark Streaming - Snowflake - Databricks About the project In Cyclad we work wih top...

  • Senior AWS Data Engineer

    1 tydzień temu

    Warsaw, Polska Cyclad Pełny etat

    Senior AWS Data Engineer Miejsce pracy: Warszawa Technologies we use Expected Glue Redshift Lambda Athena S3 Snowflake Docker Terraform CloudFormation Kafka Airflow Spark Python Scala Java Bash AWS Optional Airflow Prefect Kafka Spark Streaming Snowflake Databricks About the project In Cyclad we work wih top international IT companies in order to boost their...

  • Senior Data Engineer

    3 tygodni temu

    Warsaw, Polska B2B.NET S.A. Pełny etat

    Senior Data Engineer / ML Miejsce pracy: Warszawa Technologies we use Expected Python Spark S3 Glue SageMaker Lambda AWS SQL Bitbucket Git Optional TensorFlow PyTorch About the project We are looking for an MLOps/ML Engineer responsible for the end-to-end lifecycle of machine learning models - from development and deployment to automation and performance...

  • Senior Data Engineer ML

    3 tygodni temu

    Warsaw, Polska Lumicode Sp. z o.o. Pełny etat

    Kim jesteśmy? Lumicode Sp. z o.o. należy do Grupy Pentacomp , która jest producentem rozwiązań informatycznych i dostawcą profesjonalnych usług IT dla dużych przedsiębiorstw i sektora publicznego. Jako Pentacomp tworzymy rozwiązania IT łączące innowacyjność z latami doświadczeń - a ich mamy całkiem sporo. Istniejemy na rynku prawie 30 lat i...