Senior AWS Data Engineer

2 tygodni temu

Warszawa, Mazovia, Polska Algoteque Pełny etat
Senior AWS Data Engineer Warsaw, Masovian Voivodeship Senior AWS Data Engineer
Warszawa
Warsaw, Masovian Voivodeship, Polska

ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies. Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce. We deliver our services both in fixed-price and time-and-materials models, helping our customers achieve their business and IT strategies.

Job Description :

We are looking for an experienced specialist for the position of AWS Architect, who will be responsible for designing, developing, and automating processes within the AWS environment, with a particular focus on AWS Glue pipelines utilizing data stored in S3 in ORC/Parquet/Text formats. Responsibilities:Designing and developing processes within AWS Glue pipelines using S3. Defining standards, guidelines, and access mechanisms. Data extraction and aggregation using Python and pySpark. Managing external and managed tables in S3 and Redshift. Creating libraries for UDF functions. Building S3 buckets and managing policies for S3 buckets.

Profile / Requirements :

Requirements:Minimum of 10 years of experience in the BI/Data field. Minimum of 5 years of experience with AWS platform and data services. Proficiency in S3, Redshift, Glue, and data import services (DMS, Appflow, Data Transfer/Data Sync). Experience in creating state machines with Lambda, Glue, CloudWatch, SNS, Even Bridge. Proficiency in scripting languages: Python, pySpark. Familiarity with CloudWatch, SNS, and Even Bridge. Excellent analytical and problem-solving skills. Experience in CI/CD (preferably Gitlab), preferred AWS Code Commit, Code Build, Code Deploy services. Familiarity with Big Data ecosystems (Lake Formation, AWS EMR). Experience with Alembic. Experience working in Agile, Scrum methodology.

Firma: Algoteque

Dodano:
Praca na stanowisku - aktualna

Otrzymuj nowe oferty e-mailem

#J-18808-Ljbffr

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Rite NRG Pełny etat

    Senior Data Engineer Warszawa, Województwo mazowieckie Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi umiejętnościami możesz się pochwalić?Jesteś ekspertem w korzystaniu...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska GETINDATA POLAND sp. z o.o. Pełny etat

    Senior Data Engineer (Flink) Warsaw, Masovian Voivodeship Senior Data Engineer (Flink) Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :JavaPythonKafkaSparktechnologies-optional :AWSabout-project :We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine...

  • Senior Data Engineer Flink

    2 tygodni temu

    Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    Salary brackets: PLN net / hour (B2B) Senior Data Engineer (Flink) Warszawa Warsaw, Polska Salary brackets: PLN net / hour (B2B)Who we're looking for?Proficiency in a programming language like Java and PythonExperience in building real-time data streaming pipelines with Apache FlinkFamiliarity with the Kafka messaging systemHands-on experience with Airflow...

  • Cybersecurity Engineer with AWS

    2 tygodni temu

    Warszawa, Mazovia, Polska L.M. Group Poland Pełny etat

    Cybersecurity Engineer with AWS We are an international recruitment agency founded in 1987, present in Poland since 2014. We specialize in recruiting for permanent and temporary positions. Our headquarters are located in Poznań, and we also have branches in Warsaw, Gdańsk, and Wrocław.Currently, we are looking for Cybersecurity Engineer with AWS for one...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska IT Performance Pełny etat

    Poszukujemy kandydatów na stanowisko: Senior Data Engineer. Praca jest dedykowana dla klienta końcowego. Jest to globalny lider w branży finansowej, który dostarcza szeroki zakres usług finansowych i inwestycyjnych. ObowiązkiTworzenie i projektowanie zaawansowanych modeli danychProjektowanie wysoce skalowalnych struktur przetwarzania...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Digital Turbine Pełny etat

    Senior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. Z O.o. Pełny etat

    Senior Data Engineer Capgemini Engineering is a world leader in engineering and R& D services.We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds.Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are a...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Serendeputy Pełny etat

    Displate Displate is a one-of-a-kind metal poster designed to capture your unique passions. We've created a 21st century canvas that's sturdy, magnet mounted, and durable enough to withstand a lifetime of intense staring. View company page Imagine a group of fascinating people...who spend time at work creating the product they absolutely love. Imagine...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Digital Turbine Pełny etat

    Data Engineer Warsaw, PolandEMEA – AGP Tech /Regular /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that captivate...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Webellian Sp. z o.o. Pełny etat

    Senior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :SQLPythonPySparkabout-project :We are looking for Middle / Senior Data Engineer, to work on a project for one of our key customers in the insurance industry. You will work in hybrid mode with your teammates based in Poland and other stakeholders located worldwide and...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska j-labs Pełny etat

    Senior Data Engineer Warszawa, Województwo mazowieckie Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala użytkownikom na pełną dywersyfikację oraz optymalizację posiadanego...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Opensignal Pełny etat

    Reporting to:Engineering ManagerLocation:PolandPurpose of RoleWe're looking for a Senior Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers. What you will be doingOwn and improve our big data pipelines in...

  • Senior Data&Reporting Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska IT Performance Pełny etat

    Poszukujemy kandydatów na stanowisko: Senior Data&Reporting Engineer. Praca jest dedykowana dla klienta końcowego. Jest to globalny lider w branży finansowej, który dostarcza szeroki zakres usług finansowych i inwestycyjnych. ObowiązkiTworzenie i projektowanie zaawansowanych modeli danychProjektowanie wysoce skalowalnych struktur przetwarzania...

  • Senior Cloud Backend Engineer with AWS and Go

    2 tygodni temu

    Warszawa, Mazovia, Polska Samsung R&D Institute Poland Pełny etat

    Senior Cloud Backend Engineer with AWS and Go Warsaw, Masovian Voivodeship Senior Cloud Backend Engineer with AWS and Go Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :AWSGotechnologies-optional :LuaMongoDBConsulJenkinsGitHub Actionsabout-project :We are one of the teams that are involved in work on the Samsung Private Cloud platform....

  • Senior DevOps Engineer AWS

    2 tygodni temu

    Warszawa, Mazovia, Polska 1dea Pełny etat

    Senior DevOps Engineer AWS Warszawa Warszawa, Mazowieckie, Polska Szukamy doświadczonegoinżyniera DevOps (AWS Cloud) , który dołączy do naszego dynamicznego zespołu. Będziesz odpowiedzialny za zarządzanie infrastrukturą AWS u jednego z naszych kluczowych klientów.Warunki zaangażowania:Obszar: Consulting ITLokalizacja: 100% zdalnieStart: ASAP...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Circle K Pełny etat

    Job DescriptionThe Senior Data Engineer plays a crucial role in developing data exchange interfaces for essential business applications in the global fuels logistic processes. This position requires technical expertise in ETL processes as well as strategic thinking in terms of architecture and project management.This presents a great opportunity to enhance...

  • Senior Machine Learning Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska yellow brick road Pełny etat

    Piszesz RAGi? Chcesz porozmawiać o pracy w fajnej międzynarodowej produktówce?Naszym klientem jest wiodąca światowa marka z branży JobTech, działająca w obszarach:danychplatformytechnologiiMisją firmy jest wprowadzenie stałej zmiany na rynku pracy, poprzez wykorzystanie technologii, zwłaszcza AI, ML i LLM.Obecnie firma rozwija kilka use-case'ów...

  • Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Smartchoice International Pełny etat

    Job Title: Big Data EngineerLocation: Warsaw, PolandEmployment Type: B2BRole Description:We are seeking a highly skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Spark and Scala in a Cloud PaaS environment, specifically with AWS, Databricks, and Snowflake. The role requires proficiency in the...

  • Solutions Architect, AWS Startups

    2 tygodni temu

    Warszawa, Mazovia, Polska AWS EMEA SARL (Poland Branch) Pełny etat

    Startup Solutions Architects work hand in hand with AWS customers to help them make the most of the Cloud. They are at the crossroads of business and technology and engage with startups of different stages. Supporting the overall technical relationship between customers and AWS, they work to understand the customer's business needs and give prescriptive...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data...