Senior Data Engineer

1 dzień temu


Warsaw, Polska Sunscrapers sp. z o.o. Pełny etat

Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.

The project:

We are carrying out the project for our client, an American private equity and investment management fund - listed on the Forbes 500 list - based in New York.

We support them in the area of the infrastructure and data platform, and very recently we also build and experiment with Gen AI applications. The client operates very widely in the world of finance, loans, investments and real estate.

As a Senior Data Engineer you’ll design and implement core systems that enable data science and data visualization at companies that implement data-driven decision processes to create a competitive advantage.

You’ll build data platform for data and business teams, including internal tooling, data pipeline orchestrator, data warehouses and more, using:

Technologies: Python, Terraform, SQL, Pandas, Shell scripts

Tools: git, Docker, Snowflake, Pinecone, Neo4j, Jenkins, Jupyter Notebook, OpenAI API, Apache Airflow / Astronomer, Kubernetes, Artifactory, Windows with WSL, Linux, Gitlab

AWS: EC2, ELB, IAM, RDS, Route53, S3, and more

Best Practices: Continuous Integration, Code Reviews

The ideal candidate will be well organized, eager to constantly improve and learn, driven and, most of all - a team player

Your responsibilities will include:

- Developing PoCs using latest technologies, experimenting with third party integrations
- Delivering production grade applications once PoCs are validated
- Creating solutions that enable data scientists and business analysts to be self-sufficient as much as possible.
- Finding new ways how to leverage Gen AI applications and underlying vector and graph data storages
- Designing datasets and schemes for consistency and easy access
- Contributing data technology stacks including data warehouses and ETL pipelines
- Building data flows for fetching, aggregation and data modeling using batch and streaming pipelines
- Documenting design decisions before implementation

Requirements

What's important for us?

- At least 5+ years of professional experience in data-related role
- Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
- Expertise in Python and SQL languages
- Experience with data warehouses (Snowflake)
- Experience with different types of database technologies (RDBMS, vector, graphs, document based, etc.)
- Expertise in AWS stack and services
- Proficiency in using Docker
- Experience with infrastructure-as-code tools, like Terraform
- Great analytical skills and attention to detail - asking questions and proactively searching for answers
- Excellent command in spoken and written English, at least C1
- Creative problem-solving skills
- Excellent technical documentation and writing skills
- Ability to work with both Windows and Unix-like operating systems as the primary work environments

You will score extra points for:

- Experience with integrating LLMs (OpenAI but also others, maybe open source)
- Understanding of LLMs fine tuning, embedding and vector semantic searching
- Experience with Pinecone or Neo4j

- Familiarity with data visualization in Python using either Matplotlib, Seaborn or Bokeh
- Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
- Experience in building ETL processes and data pipelines with platforms like Airflow or Luigi
- Knowledge of any Python web framework, like Django or Flask with SQLAlchemy
- Experience in operating within a secure networking environment, like a corporate proxy
- Experience in working with repository manager, for example Jfrog Artifactory

Benefits

What do we offer?

- Working alongside a talented team of software engineers who are changing the image of Poland abroad
- Culture of teamwork, professional development and knowledge sharing (https://www.youtube.com/user/sunscraperscom)
- Flexible working hours and remote work possibility
- Comfortable office in central Warsaw, equipped with all the necessary tools for conquering the universe (Macbook Pro/Dell, external screen, ergonomic chairs)

Sounds like a perfect place for you? Don’t hesitate to click apply and submit your application today



  • Warsaw, Polska Alter Solutions Pełny etat

    The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Responsibilities - Development tasks in scope of the data warehousing solutions; - Development...


  • Warsaw, Polska Intuition Machines, Inc. Pełny etat

    Intuition Machines uses AI/ML to build enterprise security products. We apply our research to systems that serve hundreds of millions of people, with a team distributed around the world. You are probably familiar with our best-known product, the hCaptcha security suite. Our approach is simple: low overhead, small teams, and rapid iteration. We are seeking a...


  • Warsaw, Polska Sunscrapers sp. z o.o. Pełny etat

    Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...

  • Senior Data Engineer

    7 godzin temu


    Warsaw, Polska Sunscrapers Pełny etat

    Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...


  • Warsaw, Polska Holisticon Connect Pełny etat

    Holisticon Connect is a division within NEXER GROUP - a custom software development company. We started in Poland in 2017 and are now a team of over 140 people with offices in Wrocław, Warsaw, and Cracow. We have the opportunity to work with world-renowned brands from Scandinavia, the UK, and Western Europe. Our goal is to grow stronger, in competence...

  • Senior BI

    5 dni temu


    Warsaw, Polska CD PROJEKT RED Pełny etat

    We are seeking a Senior BI & Data Engineer to join our data team. In this pivotal role, you will contribute to the development of our in-house game data platform and establish our analytical processing standards. Your primary mission will be to activate and streamline data usage for various stakeholders. You will collaborate closely with our analytics and...

  • Data Engineer

    4 dni temu


    Warsaw, Polska SIX Pełny etat

    Data Engineer Warsaw | working from home up to 40% | Reference 6864     Within the Swiss exchange, Index IT is responsible for calculating all our indices such as "SMI" with high precision. We are an international team with more than 10 nationalities and are expanding to become an global index provider. Our index platform is of great importance to SIX...


  • Warsaw, Polska Lingaro Pełny etat

    We are seeking an experienced Cloud Data Engineer proficient with SQL, Azure cloud stack and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks: Designing and implementing data processing systems on Azure platform. This involves writing efficient...


  • Warsaw, Polska Billennium Pełny etat

    We are seeking a Senior MLOps Engineer with a strong background in machine learning and data science. The ideal candidate will have experience in developing and deploying applications that leverage large language models (LLMs), with a focus on agentic design and automation within the MLOps pipeline. Key responsibilities: Design, build, and optimize ML...


  • Warsaw, Polska SEB (Skandinaviska Enskilda Banken) Pełny etat

    Are you a cloud data engineer who wants to create value through data and innovation and is motivated by delivering customer value with high quality? Do you also have a proactive attitude when it comes to continuous improvements and investigating new technologies and concepts, while having experience of Finanal Products? If so, this is probably a position...


  • Warsaw, Polska Roche Pełny etat

    Roche fosters diversity, equity and inclusion, representing the communities we serve. When dealing with healthcare on a global scale, diversity is an essential ingredient to success. We believe that inclusion is key to understanding people’s varied healthcare needs. Together, we embrace individuality and share a passion for exceptional care. Join Roche,...


  • Warsaw, Polska Endava Pełny etat

    Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and...


  • Warsaw, Polska Spyrosoft Pełny etat

    Job description Join our team in  Warsaw , where we’re collaborating on a cutting-edge fintech venture with a global industry leader. Together with our Partner, we’re building an IT hub designed to  drive innovation in digital payment solutions . We’re on the lookout for top-tier engineers who thrive in dynamic, forward-thinking environments....

  • Data Engineer

    1 tydzień temu


    Warsaw, Polska Procter & Gamble Pełny etat

    We are looking for a Senior Data Engineer to join our IT Data team for Intelligent Operations in Warsaw. In this role, you will be responsible for building systems that ingest and convert IT data into usable models for business analysts, data science and machine learning solutions. You will work on data transformation and visualization leveraging various...

  • Data Engineer

    4 dni temu


    Warsaw, Polska Procter & Gamble Pełny etat

    We are looking for a Senior Data Engineer to join our IT Data team for Intelligent Operations in Warsaw. In this role, you will be responsible for building systems that ingest and convert IT data into usable models for business analysts, data science and machine learning solutions. You will work on data transformation and visualization leveraging various...


  • Warsaw, Polska GFT Poland Pełny etat

    As a Data Engineer with Scala, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and compliance with the internal quality levels. Our Client is focusing on developing a DataHub. Your skills At least 3-4 years...

  • Data Engineer

    5 dni temu


    Warsaw, Polska payabl. Pełny etat

    payabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in...


  • Warsaw, Polska Lan IT 24 GmbH Pełny etat

    We at LAN IT 24 are currently Looking for Tivoli Senior Engineer for Following Locations Warszawa or Gdansk, Hybrid work mode Start: ASAP Full time (Mon-Fri/40 hour ) Hybrid work mode Tasks Responsibilities:- - Architecture, Designing, Implementation and administration of the Data Protection and recovery - Conducting the Restore Drill for Application /...


  • Warsaw, Polska Sigma Software Pełny etat

    - Troubleshoot platform issues - Participate in on-call rotations and be an escalation contact for service incidents - Address customer escalations, providing timely solutions and support - Configure and set up new customer environments to meet specific requirements - Respond promptly to PagerDuty alerts to ensure system reliability and uptime - Monitor...


  • Warsaw, Polska Devire Pełny etat

    Devire IT Outsourcing  is a form of cooperation dedicated to IT professionals, based on the principles of own business - B2B, implementing projects for clients running innovative and modern projects. Together with our client, a global leader in AI-driven financial solutions, we are expanding their tech hub in Poland and seeking highly skilled  Senior...