Senior Data Engineer
1 dzień temu
Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives.
The project:
We are carrying out the project for our client, an American private equity and investment management fund - listed on the Forbes 500 list - based in New York.
We support them in the area of the infrastructure and data platform, and very recently we also build and experiment with Gen AI applications. The client operates very widely in the world of finance, loans, investments and real estate.
As a Senior Data Engineer you’ll design and implement core systems that enable data science and data visualization at companies that implement data-driven decision processes to create a competitive advantage.
You’ll build data platform for data and business teams, including internal tooling, data pipeline orchestrator, data warehouses and more, using:
Technologies: Python, Terraform, SQL, Pandas, Shell scripts
Tools: git, Docker, Snowflake, Pinecone, Neo4j, Jenkins, Jupyter Notebook, OpenAI API, Apache Airflow / Astronomer, Kubernetes, Artifactory, Windows with WSL, Linux, Gitlab
AWS: EC2, ELB, IAM, RDS, Route53, S3, and more
Best Practices: Continuous Integration, Code Reviews
The ideal candidate will be well organized, eager to constantly improve and learn, driven and, most of all - a team player
Your responsibilities will include:
- Developing PoCs using latest technologies, experimenting with third party integrations
- Delivering production grade applications once PoCs are validated
- Creating solutions that enable data scientists and business analysts to be self-sufficient as much as possible.
- Finding new ways how to leverage Gen AI applications and underlying vector and graph data storages
- Designing datasets and schemes for consistency and easy access
- Contributing data technology stacks including data warehouses and ETL pipelines
- Building data flows for fetching, aggregation and data modeling using batch and streaming pipelines
- Documenting design decisions before implementation
Requirements
What's important for us?
- At least 5+ years of professional experience in data-related role
- Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
- Expertise in Python and SQL languages
- Experience with data warehouses (Snowflake)
- Experience with different types of database technologies (RDBMS, vector, graphs, document based, etc.)
- Expertise in AWS stack and services
- Proficiency in using Docker
- Experience with infrastructure-as-code tools, like Terraform
- Great analytical skills and attention to detail - asking questions and proactively searching for answers
- Excellent command in spoken and written English, at least C1
- Creative problem-solving skills
- Excellent technical documentation and writing skills
- Ability to work with both Windows and Unix-like operating systems as the primary work environments
You will score extra points for:
- Experience with integrating LLMs (OpenAI but also others, maybe open source)
- Understanding of LLMs fine tuning, embedding and vector semantic searching
- Experience with Pinecone or Neo4j
- Familiarity with data visualization in Python using either Matplotlib, Seaborn or Bokeh
- Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
- Experience in building ETL processes and data pipelines with platforms like Airflow or Luigi
- Knowledge of any Python web framework, like Django or Flask with SQLAlchemy
- Experience in operating within a secure networking environment, like a corporate proxy
- Experience in working with repository manager, for example Jfrog Artifactory
Benefits
What do we offer?
- Working alongside a talented team of software engineers who are changing the image of Poland abroad
- Culture of teamwork, professional development and knowledge sharing (https://www.youtube.com/user/sunscraperscom)
- Flexible working hours and remote work possibility
- Comfortable office in central Warsaw, equipped with all the necessary tools for conquering the universe (Macbook Pro/Dell, external screen, ergonomic chairs)
Sounds like a perfect place for you? Don’t hesitate to click apply and submit your application today
-
Senior Data Engineer
4 dni temu
Warsaw, Polska Alter Solutions Pełny etatThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Responsibilities - Development tasks in scope of the data warehousing solutions; - Development...
-
Senior Data Engineer
5 dni temu
Warsaw, Polska Intuition Machines, Inc. Pełny etatIntuition Machines uses AI/ML to build enterprise security products. We apply our research to systems that serve hundreds of millions of people, with a team distributed around the world. You are probably familiar with our best-known product, the hCaptcha security suite. Our approach is simple: low overhead, small teams, and rapid iteration. We are seeking a...
-
Senior Data Engineer
2 dni temu
Warsaw, Polska Sunscrapers sp. z o.o. Pełny etatAdvance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...
-
Senior Data Engineer
7 godzin temu
Warsaw, Polska Sunscrapers Pełny etatAdvance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. Enjoy a competitive compensation package that reflects your skills and expertise while working in...
-
Senior Bioinformatics Data Engineer
7 godzin temu
Warsaw, Polska Holisticon Connect Pełny etatHolisticon Connect is a division within NEXER GROUP - a custom software development company. We started in Poland in 2017 and are now a team of over 140 people with offices in Wrocław, Warsaw, and Cracow. We have the opportunity to work with world-renowned brands from Scandinavia, the UK, and Western Europe. Our goal is to grow stronger, in competence...
-
Senior BI
5 dni temu
Warsaw, Polska CD PROJEKT RED Pełny etatWe are seeking a Senior BI & Data Engineer to join our data team. In this pivotal role, you will contribute to the development of our in-house game data platform and establish our analytical processing standards. Your primary mission will be to activate and streamline data usage for various stakeholders. You will collaborate closely with our analytics and...
-
Data Engineer
4 dni temu
Warsaw, Polska SIX Pełny etatData Engineer Warsaw | working from home up to 40% | Reference 6864 Within the Swiss exchange, Index IT is responsible for calculating all our indices such as "SMI" with high precision. We are an international team with more than 10 nationalities and are expanding to become an global index provider. Our index platform is of great importance to SIX...
-
Senior Azure Data Engineer
5 dni temu
Warsaw, Polska Lingaro Pełny etatWe are seeking an experienced Cloud Data Engineer proficient with SQL, Azure cloud stack and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks: Designing and implementing data processing systems on Azure platform. This involves writing efficient...
-
Senior MLOps Engineer
5 dni temu
Warsaw, Polska Billennium Pełny etatWe are seeking a Senior MLOps Engineer with a strong background in machine learning and data science. The ideal candidate will have experience in developing and deploying applications that leverage large language models (LLMs), with a focus on agentic design and automation within the MLOps pipeline. Key responsibilities: Design, build, and optimize ML...
-
Senior Cloud Data Engineer @ SEB
5 dni temu
Warsaw, Polska SEB (Skandinaviska Enskilda Banken) Pełny etatAre you a cloud data engineer who wants to create value through data and innovation and is motivated by delivering customer value with high quality? Do you also have a proactive attitude when it comes to continuous improvements and investigating new technologies and concepts, while having experience of Finanal Products? If so, this is probably a position...
-
Data Security Engineer
5 dni temu
Warsaw, Polska Roche Pełny etatRoche fosters diversity, equity and inclusion, representing the communities we serve. When dealing with healthcare on a global scale, diversity is an essential ingredient to success. We believe that inclusion is key to understanding people’s varied healthcare needs. Together, we embrace individuality and share a passion for exceptional care. Join Roche,...
-
Senior Data Engineer with GCP
5 dni temu
Warsaw, Polska Endava Pełny etatOur data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and...
-
Senior/Lead Data Engineer @ Spyrosoft
7 godzin temu
Warsaw, Polska Spyrosoft Pełny etatJob description Join our team in Warsaw , where we’re collaborating on a cutting-edge fintech venture with a global industry leader. Together with our Partner, we’re building an IT hub designed to drive innovation in digital payment solutions . We’re on the lookout for top-tier engineers who thrive in dynamic, forward-thinking environments....
-
Data Engineer
1 tydzień temu
Warsaw, Polska Procter & Gamble Pełny etatWe are looking for a Senior Data Engineer to join our IT Data team for Intelligent Operations in Warsaw. In this role, you will be responsible for building systems that ingest and convert IT data into usable models for business analysts, data science and machine learning solutions. You will work on data transformation and visualization leveraging various...
-
Data Engineer
4 dni temu
Warsaw, Polska Procter & Gamble Pełny etatWe are looking for a Senior Data Engineer to join our IT Data team for Intelligent Operations in Warsaw. In this role, you will be responsible for building systems that ingest and convert IT data into usable models for business analysts, data science and machine learning solutions. You will work on data transformation and visualization leveraging various...
-
Mid/Senior Data Engineer with Scala @ GFT Poland
7 godzin temu
Warsaw, Polska GFT Poland Pełny etatAs a Data Engineer with Scala, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and compliance with the internal quality levels. Our Client is focusing on developing a DataHub. Your skills At least 3-4 years...
-
Data Engineer
5 dni temu
Warsaw, Polska payabl. Pełny etatpayabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in...
-
Tivoli Senior Engineer m/w/d
5 dni temu
Warsaw, Polska Lan IT 24 GmbH Pełny etatWe at LAN IT 24 are currently Looking for Tivoli Senior Engineer for Following Locations Warszawa or Gdansk, Hybrid work mode Start: ASAP Full time (Mon-Fri/40 hour ) Hybrid work mode Tasks Responsibilities:- - Architecture, Designing, Implementation and administration of the Data Protection and recovery - Conducting the Restore Drill for Application /...
-
Senior Technical Support Engineer
5 dni temu
Warsaw, Polska Sigma Software Pełny etat- Troubleshoot platform issues - Participate in on-call rotations and be an escalation contact for service incidents - Address customer escalations, providing timely solutions and support - Configure and set up new customer environments to meet specific requirements - Respond promptly to PagerDuty alerts to ensure system reliability and uptime - Monitor...
-
Senior Python Engineer @ Devire
7 godzin temu
Warsaw, Polska Devire Pełny etatDevire IT Outsourcing is a form of cooperation dedicated to IT professionals, based on the principles of own business - B2B, implementing projects for clients running innovative and modern projects. Together with our client, a global leader in AI-driven financial solutions, we are expanding their tech hub in Poland and seeking highly skilled Senior...