Senior AWS Data Engineer

7 dni temu


Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat
technologies-expected :

Python

SQL

Microsoft Power BI

about-project :

As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:

This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is at the early stages of the development, covering design of architecture and processes, as well as giving freedom for technology selection.

This project addressed critical data management challenges, boosting user adoption, performance, and data integrity. Secure integration solutions and enhanced data quality monitoring, utilizing Delta Live Table tests, established trust in the platform. The intermediate result is a user-friendly, secure, and data-driven platform, serving as a basis for further development of ML components.

This project aims to build a data processing system for both real-time streaming and batch data. We'll handle data for business uses like process monitoring, analysis, and reporting, while also exploring LLMs for chatbots and data analysis. Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.

Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.

Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment.

Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.

Ensure data security, compliance, and governance best practices are followed across all data pipelines.

At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.

Strong programming skills in Python: writing a clean code, OOP design.

Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.

Deep expertise in Big Data technologies, including Apache Airflow, Dagster, Databricks, Spark, DBT, and other modern data orchestration and transformation tools.

Experience implementing and deploying solutions in cloud environments (with a preference for Azure).

Knowledge of how to build and deploy Power BI reports and dashboards for data visualization.

Consulting experience and the ability to guide clients through architectural decisions, technology selection, and best practices.

Ability to work independently and take ownership of project deliverables.

D. in Computer Science, Data Science, Mathematics, Physics, or a related field.

Work in a supportive team of passionate enthusiasts of AI & Big Data.

Engage with top-tier global enterprises and cutting-edge startups on international projects.

Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.

B2B, employment contracts, or contracts of mandate.

Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.

Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.

private medical care

sharing the costs of professional training & courses

remote work opportunities

video games at work

coffee / tea
  • Senior Data Engineer AWS

    4 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Provectus Pełny etat

    We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...


  • Wrocław, Województwo dolnośląskie, Polska Sii Sp. z o.o. Pełny etat

    Senior Data Engineer with AWS and SnowflakeLocation: Wrocław, Lower Silesian Voivodeship, PolskaWe are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support clinical and operational data use...


  • Wrocław, Województwo dolnośląskie, Polska Experis ManpowerGroup Sp. z o.o. Pełny etat

    Senior Data Engineer Job DescriptionWe are seeking a Senior Data Engineer to lead and mentor a team of data engineers while staying hands-on with data pipelines, architecture, and system optimization.Key Responsibilities:Design and implement scalable data architectureBuild ETL data pipelines using Airflow, SnowFlake, DBTDefine and enforce data partitioning,...

  • AWS DevOps Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Correct Context is looking for an AWS DevOps Engineer  for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology,...


  • Wrocław, Województwo dolnośląskie, Polska Appfire Pełny etat

    Appfire seeks a highly skilled Senior Security Engineer to join our Appfire Information Security team. This Senior Security Engineer role will report to our CISO and work within our Security Engineering & Architecture team to handle diverse security engineering and architecture-related tasks for our rapidly growing company, including managing risk through a...


  • Wrocław, Województwo dolnośląskie, Polska Provectus Pełny etat

    We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...


  • Wrocław, Województwo dolnośląskie, Polska Sii Sp. z o.o. Pełny etat

    We are looking for a talented Snowflake and AWS expert to join our team as a Senior Data Architect. As a senior member of our team, you will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems.Key Responsibilities:Lead Data Architecture: Design and develop data architectures incorporating Snowflake,...


  • Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    technologies-expected : Google Cloud Platform Python Snowflake SQL technologies-optional : about-project : ~ As a Senior Data Engineer at Xebia, you will work closely with engineering, product, and data teams to deliver our clients scalable and robust data solutions. Your key responsibilities will include designing, building, and maintaining data platforms...


  • Wrocław, Województwo dolnośląskie, Polska DataRiseLab Pełny etat

    SENIOR DATA ENGINEER ABOUT US We are an IT Company offering our Clients with a comprehensive support in development and maintenance of data management solutions (data warehouses, data integration, BI reporting, Big Data), defining data and information management strategies in the organization, creating advanced data analytics solutions as well as cloud...

  • DevOps/AWS Engineer

    6 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Capgemini Pełny etat

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • AWS Solutions Architect

    3 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Gradient IT Pełny etat

    About UsGradient IT is a leading provider of investment management solutions to clients worldwide. Our team of experts has extensive experience in developing and implementing complex systems, and we are now looking for a Senior DevOps Engineer to join our team.Job DescriptionWe are seeking a highly skilled Senior DevOps Engineer to join our team. The...

  • Senior DevOps Engineer

    7 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Gradient IT Pełny etat

    Senior DevOps Engineer (AWS), Investment Management SolutionsTbilisi Yerevan Krakow Remote.BG Remote.PL Wroclaw Sofia Remote.LATAMPost Date: 4/13/2022Our client is a US-based investment management business of an American Fortune Global 500 and Fortune 500 company whose subsidiaries provide insurance, investment management, and other financial products and...


  • Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat

    We're looking for a highly skilled Senior Data Engineer to help us build a modern cloud-based data processing platform, enabling efficient management and real-time analysis of large datasets.The ideal candidate will have experience in designing and implementing cloud-based data processing platforms, leveraging Azure, Apache Spark, and Data Lakehouse...

  • Data Engineer

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Holisticon Connect Pełny etat

    Holisticon Connect is a division within NEXER GROUP - a custom software development company. We started in Poland in 2017 and are now a team of over 140 people with offices in Wrocław, Warsaw, and Cracow. We have the opportunity to work with world-renowned brands from Scandinavia, the UK, and Western Europe. Our goal is to grow stronger, in competence...

  • DevOps / AWS Engineer @

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Shift4 Pełny etat

    Our approach We don't try to reinvent the wheel when we can leverage  AWS capabilities Automation  over tedious tasks Building the  self-healing IT infrastructure Systematic  scalability assessment Over 60 AWS services  implemented, including:  CloudFormation/CDK, Ansible, Packer, Jenkinsfile, Chaos Toolkit Aurora, DMS, Redshift, RDS, DynamoDB,...


  • Wrocław, Województwo dolnośląskie, Polska ALGOTEQUE Innovation Hub Pełny etat

    About us at ALGOTEQUE Innovation Hub:We specialize in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce sectors.Our Requirements:We seek a highly experienced DevOps Engineer with in-depth knowledge of AWS Cloud to join our team....


  • Wrocław, Województwo dolnośląskie, Polska Godel Technologies Europe Pełny etat

    We're looking for a Senior Software Engineer to join our team and work with us and our client team on a lab workflow automation platform. Ideal candidates have strong Python experience, are comfortable working with the React frontend and AWS, supervising less-experienced engineers. Passion for software development, excellent communication, and commitment to...

  • Data Architect AWS

    3 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Experis Manpower Group Pełny etat

    Tasks:Design, develop, and deploy scalable data architectures for collection, storage, processing, and analysis.Mentor the data engineering team while building and optimizing ETL pipelines with Airflow, Snowflake, and DBT.Define data partitioning, retention, governance, and security strategies.Translate business needs into technical specifications and...

  • DevOps AWS Engineer

    3 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska Shift4 Pełny etat

    Our approach We don't try to reinvent the wheel when we can leverage AWS capabilities Automation over tedious tasks  Building the self-healing IT infrastructure Systematic scalability assessment Over 60 AWS services implemented, including:  CloudFormation/CDK, Ansible, Packer, Jenkinsfile, Chaos Toolkit Aurora, DMS, Redshift, RDS, DynamoDB, ElastiCache...

  • Data Engineer @

    2 tygodni temu


    Wrocław, Województwo dolnośląskie, Polska SNI Pełny etat

    Job details: Remote/hybrid work Senior level Start date: March 2025 1st contract till the end of 2025 Candidates' location: Poland, preferably Wroclaw area Occasional travels possible Scope: We are looking for Senior Data Engineer with experience/knowledge in AI projects to join our team and help us integrate AI solutions into client's applications. In this...