Senior Data Engineer
2 tygodni temu
Remote/Wroclaw
B2B contract – daily rate pln
Your role and main tasks
- Development of Central Lakehouse Data Platform based on AWS / Databricks ecosystem
- Managing data infrastructure (Terraform AWS / Databricks) and ETL code (PySpark, Delta Live Tables, SparkSQL)
- Implementing monitoring, data quality tests, unit testing for code, and automated alerts into the system
- Refactoring legacy AWS solutions (AWS Glue, Redshift) into monitored and CI/CD deployed Lakehouse ecosystem with data expectations / data quality testing
- Active support for building medallion lakehouse architecture for ML and analytics data and introducing data-mesh concepts
- Active support for business analytics and ML teams working on the data platform
You will need
- degree in Information Systems, Computer Science, Mathematics/Physics, Engineering, or a related field
- several years of experience building data engineering solutions (ideally in E-commerce)
- very good knowledge of Python programming (building applications, automated testing, packaging and deployment)
- real experience with PySpark data processing and good understanding of Spark processing engine architecture
- Advanced SQL processing skills
- experience with data lakes architecture and data modelling paradigms
- experience with Terraform infrastructure-as-code and CI/CD deployments
- experience with building and deploying data engineering ETL applications – CI/CD pipelines in git environments
- Fluency in English – we work in an international environment
- Team player attitude and willingness to learn modern technologies / frameworks
Nice-to-have
- Familiarity with AWS Cloud architecture and Databricks platformwill be very welcomed
- Experience with AWS Glue and Redshift warehousing
- Experience with CloudFormation templates
- Experience with AWS Kinesis and Spark streaming processing
- Good knowledge of Scala coding, functional programming and application development
- Experience with MLOps environments (e. g. , MLFlow)
- Access to private healthcare, ensuring the well-being of you and your loved ones.
- Language classes in English and German, tailored to your skill level.
- Remote work opportunities and flexible working hours to accommodate your schedule.
- Co-finance of Multi-sport card
- Office located in the vibrant center of Wrocław, with nearby amenities including cinemas, fitness clubs, and a variety of lunch options.
- After hours we often organize interesting outings or meetings in our office or near byJ
#J-18808-Ljbffr
-
Senior Data Engineer Flink
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska GetInData | Part of Xebia Pełny etatSenior Data Engineer Flink Wrocław, Województwo dolnośląskie Senior Data Engineer Flink Wrocław Wrocław, Lower Silesian Voivodeship, Polska Informacje: Lokalizacja: Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Wrocław - Ciekawe oferty pracy w okolicy:WrocławOferty pracy w okolicznych...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Scalo Sp. z o.o. Pełny etatSenior Data Engineer (DataBricks + SQL + Python) Wrocław, Województwo dolnośląskie Senior Data Engineer (DataBricks + SQL + Python) Wrocław Wrocław, Lower Silesian Voivodeship, Polska uczestnictwo w międzynarodowym projekcie z branży automotive, w odniesieniu do usprawnienia systemu do zarządzania materiałami, przygotowania raportu Power BI, który...
-
Senior Data Engineer @
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska SNI Pełny etatSNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.We're on the lookout for a Senior Data Engineer for one of our key clients.Job details:Full-time 1st contract till the end of 2024 Location: pref. Wroclaw area or close locations but open for 100% remote...
-
Senior Backend Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Kalepa Pełny etatWho are we?Kalepa is a fully remote startup dedicated to enhancing underwriting performance and driving profitable premium growth for the commercial insurance industry. Kalepa's AI-powered Copilot software enables underwriters to focus on the highest ROI opportunities and quickly evaluate and optimally select risk. Kalepa is backed by IA Ventures, Inspired...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Rite NRG Pełny etatSenior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi umiejętnościami możesz się pochwalić?Jesteś...
-
Senior Data Engineer z jniemieckim
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska dmTECH Polska Pełny etatSenior Data Engineer z jniemieckim Wrocław, Lower Silesian Voivodeship Senior Data Engineer z jniemieckim Wrocław Wrocław, Dolnośląskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....
-
Mid Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska TransferGo Pełny etatTransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. Now in our 12th year, with over 370 employees in offices across Europe, we're crafting a brilliant, relevant product that makes a difference in...
-
Senior Data Engineer Analyst
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Sunscrapers Pełny etatAre you ready to take on the challenge?We're looking for a Senior Data Engineer/Analyst to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Shaped Thoughts Sp. Z O.o. Pełny etatTechnologies-expected : Amazon Redshift Snowflake Google Big Query SQL Python Java technologies-optional : AWS Glue Apache Spark Apache Flink Kinesis Kafka about-project : We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.responsibilities : help...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska j-labs Pełny etatSenior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala użytkownikom na pełną dywersyfikację oraz...
-
Senior Data Engineer Python Pyspark Cloud
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Crestt Pełny etatSenior Data Engineer Python Pyspark Cloud Wrocław Wrocław, Lower Silesian Voivodeship, Polska CześćJako Senior/Lead Data Engineer będziesz miał możliwość pracy nad kluczowym projektem naszego klienta, który obejmuje budowanie mechanizmu składowania danych decyzyjnych. Projekt ten oferuje unikalną szansę na zaangażowanie w tworzenie i...
-
Senior Data Virtualization Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Epam Pełny etatDescription Are you a seasoned Data Virtualization Engineer skilled in Databricks and Denodo? Join our team as a Senior Data Virtualization Engineer, where you'll be at the forefront of an exciting project in the Client's Asset Management division. Leverage your expertise in data virtualization, storage, processing, and streaming data at scale to develop...
-
Mid Senior Data Analytics Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska TransferGo Pełny etatTransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. Now in our 12th year, with over 370 employees in offices across Europe, we're crafting a brilliant, relevant product that makes a difference in...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Limango Pełny etatSenior Data Engineer At limango we have a long history specializing in e-commerce. As part of the OTTO Group, one of Europe's top e-commerce companies, we offer the largest product selection for families across platforms in the Netherlands, Poland, Austria, and Germany. Your role and main tasks Development of Central Lakehouse Data Platform based on AWS /...
-
Senior Big Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Scalac Pełny etatWe are looking for a Senior Big Data Engineer with Spark who will be working on an external project in the fintech area. But what's more important is that you will still be an integral part of the Scalac team and work with the best specialists As a Big Data Engineer, you will:Work on an external project and develop an application that is based on the Hadoop...
-
Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etatSenior Data Virtualization Engineer Wroclaw, Poland or Remote Wrocław, Lower Silesian Voivodeship Senior Data Virtualization Engineer Wroclaw, Poland or Remote 96206Engineer solutions focused on data virtualization, distributed processing, and cloud-based large data storage architectureCreate and implement highly scalable and reliable data distribution...
-
Senior Python Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska EPAM Systems Pełny etatSenior Python Engineer (with Pandas and AWS) Poland Wrocław, Lower Silesian Voivodeship Senior Python Engineer (with Pandas and AWS) Poland 95353Build and enhance a highly concurrent backend system for processing large volumes of data, using Python and packages like Pandas, Numpy, SQLAlchemyWork with high performance computingWork with bigdata storage and...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Scalo Sp. Z O.o. Pełny etatTechnologies-expected : SQL Data Bricks Data Factory Data Lake Azure SQL DB Azure Dev Ops responsibilities : uczestnictwo w międzynarodowym projekcie z branży automotive, w odniesieniu do usprawnienia systemu do zarządzania materiałami, przygotowania raportu Power BI, który obejmuje pomiar śladu węglowego, w dążeniu do osiągnięcia zerowego poziomu...
-
Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Link Group Pełny etatJob Description:As a member of our Finance team, you will be an integral part of our "Financial Transformation" project, aimed at providing the Finance department with accurate and well-structured data. This role involves integrating seamlessly with source systems and establishing data layers that meet business requirements. Your primary responsibilities...
-
Mid +/Senior Data Engineer
2 tygodni temu
Wrocław, Województwo dolnośląskie, Polska Capco Pełny etat*We are looking for Poland based candidate. The job is hybrid from Wroclaw.Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we...
