Senior Data Engineer

4 tygodni temu

Warsaw, Polska INNOBO sp. z o.o. Pełny etat

technologies-expected :

- Python
- Spark
- AWS
- TensorFlow
- PyTorch
- SQL
- Hive SQL
- BitBucket
- Git

about-project :

- Client: banking industry
- Hourly Rate: up to 160 PLN + VAT
- Location: Gdansk or Gdynia or Warsaw or Lodz, Poland
- Work arrangement: hybrid, 2 days at the office, full-time
- For our Client from banking industry we are looking for Senior Data Engineer/ML Engineer.

responsibilities :

- Managed the lifecycle of machine learning models from development to deployment and monitoring, ensuring optimal performance and reliability.
- Implemented MLOps principles, including continuous integration, continuous delivery, testing, and monitoring, to streamline machine learning operations.
- Working with Spark & Python to define and maintain data ingestions and transformation, handling both real-time and batch data processing.
- Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time.
- Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics.
- Collaborated with cross-functional teams, including data scientists, DevOps engineers, and IT, to deliver high-quality machine learning solutions.
- Working closely with analysts and business stakeholders to develop analytics models.
- Help in optimizing our current MLOps practices and libraries, make applicable for wider range of use cases outside propensity models.
- Cloud solution exploration for AI/ML areas.

requirements-expected :

- Proficiency in programming languages like Python & Spark - minimum 5 years.
- Hands-on experience with AWS services for machine learning and data processing - particulary S3, Glue, SageMaker, Lambda and StepFunctions/Airflow/MWAA - covering data ingestion, model training, batch inference and automation pipelines.
- Practical understanding of AWS Infrastracture setup and automation using AWS CLI, boto3 and IAM roles, ensuring reproducible and secure ML workflows.
- Understanding of algorithms and data structures, knowledge of statistics and linear algebra.
- Experience with machine learning frameworks (TensorFlow or PyTorch), including training new ML models, refining existing ones, and deploying these models into user-friendly applications.
- Solid understanding of distributed systems with experience in Hadoop/Hive ecosystem and/or other Big Data Technologies.
- Proficient in SQL (Spark/Hive SQL), previous experience in creating data flows.
- Experience with BitBucket and GIT, code versioning and branching strategy.
- Familiar with Agile/Safe framework.

  • Senior Data Engineer

    1 tydzień temu

    Warsaw, Polska Insightify Pełny etat

    We are seeking a highly skilled and experienced Senior Data Engineer with solid expertise in AWS, Azure & GCP, along with proficiency in modern data transformation tools such as dbt and Databricks. Tasks In the role of Senior Data Engineer, you will be entrusted with the task of conceptualizing and implementing scalable and secure cloud-based data...

  • Senior Azure Data Engineer

    1 tydzień temu

    Warsaw, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz ciekawe projekty IT skierowane zarówno do ekspertów z wieloletnim doświadczeniem, jak i osób, które dopiero zaczynają swoją przygodę w branży IT. Senior Azure Data Engineer – Hybrid...

  • Senior Data Engineer Python Django

    2 tygodni temu

    Warsaw, Polska P&P Solutions Pełny etat

    Our client from the insurance industry is developing an advanced dashboard that presents key risk metrics for investors as well as performance indicators for the investment portfolio. The tool includes complex visualizations and reports that are frequently reviewed by senior leadership. As a Senior Data Engineer, you will be responsible for maintaining and...

  • Senior Data Engineer

    2 tygodni temu

    Warsaw, Polska emagine Polska Pełny etat

    Rate: B2B – 37-42 EUR/h. Work model: fully remote. Project length: 12 months extensions. Start date for assignment: ASAP/ 1 month. Project language: English, Polish. Industry: pharmaceutical. Recruitment process : 2 interviews with the client. Workload: Full time. Job Description Are you passionate about data engineering and developing data products that...

  • Senior Data Engineer

    3 tygodni temu

    Warsaw, Polska Polski Standard Płatności S.A. Pełny etat

    Senior Data Engineer Miejsce pracy: Warszawa Technologie, których używamy Wymagane Python O projekcie Szukamy samodzielnych seniorów, którzy chcą mieć realny wpływ, a nie tylko "dowodzić tickety". Pracujemy w modelu "wolno, drogo, ale dobrze". Budujemy platformę danych od zera, kształtujemy kulturę data-driven w całej organizacji i decydujemy,...

  • Senior Data Engineer

    4 dni temu

    Warsaw, Polska Procter & Gamble Pełny etat

    Job Description The Senior Data Engineer is responsible for designing, developing, and implementing data and analytics Microsoft Azure Databricks Platform and pipelines that acquire, cleanse, transform, and publish data from a wide variety of sources. Key Responsibilities: Assemble large complex data sets which meet functional and non-functional business...

  • Senior Software Engineer

    2 tygodni temu

    Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etat

    Senior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected - Java - Typescript - Pulumi - Terraform Optional - Trino Operating system - macOS About the project As a Senior Software Engineer on the fully distributed Starburst Galaxy Reliability, Scalability, & Efficiency team, you’ll own the reliability, scalability and...

  • Senior Software Engineer

    2 tygodni temu

    Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etat

    Senior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected Java Typescript Pulumi Terraform Optional Trino Operating system macOS About the project As a Senior Software Engineer on the fully distributed Starburst Galaxy Reliability, Scalability, & Efficiency team, you'll own the reliability, scalability and efficiency (performance/$) of...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Bayer Sp. z o.o. Pełny etat

    At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where ,Health for all, Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our capabilities and...

  • Senior Software Engineer

    3 tygodni temu

    Warsaw, Polska STARBURST DATA POLSKA sp. z o.o. Pełny etat

    Senior Software Engineer Miejsce pracy: Warszawa Technologies we use Expected Java Operating system Windows About the project Starburst is looking for strong Java engineers to work with our globally distributed engineering team on the core of Starburst's software. This is a great opportunity to deepen your expertise in a rapidly evolving technology and make...