Data Engineering Leader

3 dni temu

Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etat

About Sunscrapers

Sunscrapers is a technology consultancy that empowers finance and healthcare leaders to succeed by leveraging cutting-edge software, data, and AI. We combine world-class engineering, deep industry expertise, and proprietary know-how to deliver innovative, high-impact solutions. Our specialization lies in software engineering, DevOps, data engineering, and data science, where we design and build AI-powered data platforms and web applications tailored to each client's unique needs.

Trusted by over 60 clients across the US, UK, and beyond, we consistently maintain a 4.9/5 client satisfaction rating, with partnerships averaging five years or more. Our extensive experience has equipped us with the knowledge and skills required to support clients in various sectors, including finance, loans, investments, and real estate.

The Project

We are currently working on a project for an American private equity and investment management fund listed on the Forbes 500 list, based in New York. The project focuses on infrastructure and data platform support, as well as experimenting with Gen AI applications. This collaboration enables us to leverage our expertise in designing and implementing core systems that facilitate data science and visualization at companies employing data-driven decision-making processes to achieve a competitive advantage.

Your Role and Responsibilities

As a Senior Data Engineer, you will be responsible for designing and implementing data platforms for businesses and internal tooling, utilizing technologies such as Python, Terraform, SQL, Pandas, and Shell scripts. You will work with tools like Apache Airflow/Astronomer, GIT, Docker, Kubernetes, Snowflake, Pinecone, Neo4j, Jenkins, Jupyter Notebook, OpenAI API, Artifactory, Windows with WSL, Linux, and Gitlab.

You will also contribute to designing datasets and schemes for consistency and easy access, building data flows for fetching, aggregation, and data modeling using batch and streaming pipelines. Additionally, you will document design decisions before implementation.

Requirements and Qualifications

  • At least 7+ years of professional experience in a data-related role
  • Experience with infrastructure-as-code tools, such as Terraform
  • Proficiency in using Airflow
  • Expertise in AWS stack and services (EC2, ELB, IAM, RDS, Route53, S3, and more)
  • Proficiency in using Docker
  • Expertise in Python and SQL languages
  • Experience with data warehouses (Snowflake)
  • Experience with different types of database technologies (RDBMS, vector, graphs, document-based, etc.)
  • Great analytical skills and attention to detail - asking questions and proactively searching for answers
  • Excellent command of spoken and written English, at least C1
  • Creative problem-solving skills
  • Excellent technical documentation and writing skills
  • Ability to work with both Windows and Unix-like operating systems as primary work environments
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar

Preferred Qualifications

  • Experience with integrating LLMs (OpenAI but also others, maybe open-source)
  • Familiarity with data visualization in Python using either Matplotlib, Seaborn, or Bokeh
  • Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
  • Knowledge of any Python web framework, like Django or Flask with SQLAlchemy
  • Experience in operating within a secure networking environment, like a corporate proxy
  • Experience in working with repository manager, for example Jfrog Artifactory

Benefits

We offer a dynamic and supportive work environment, allowing for personal and professional growth. As a member of our team, you will have the opportunity to:

  • Work alongside talented software engineers who are changing the image of Poland abroad
  • Participate in a culture of teamwork, professional development, and knowledge sharing
  • Enjoy flexible working hours and remote work possibilities
  • Use modern office equipment and facilities in central Warsaw

  • Cloud Data Engineering Leader

    2 dni temu

    Warszawa, Mazovia, Polska Innowise Group Pełny etat

    As a Cloud Data Engineering Leader at Innowise Group, you will lead our data engineering team in designing and implementing cloud-based data solutions. Our ideal candidate will have hands-on experience with modern data processing technologies such as Amazon Web Services (AWS) Glue and Azure Data Factory.You will work closely with cross-functional teams to...

  • Data Engineering Leader

    1 tydzień temu

    Warszawa, Mazovia, Polska CLOUDFIDE SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing modern cloud-based solutions. This includes building and launching new data models and data pipelines, as well as implementing best practices in data engineering including data...

  • Data Engineering Leader

    4 dni temu

    Warszawa, Mazovia, Polska Inetum Pełny etat

    Job OverviewInetum, a leading IT services company, seeks a seasoned Senior/Architect Data Engineer to drive innovation in data engineering. As a key member of our team, you will be responsible for recruiting new talent, analyzing business and technical needs, developing proposals, and improving technical and business processes.

  • Data Engineering and AI Leader

    3 dni temu

    Warszawa, Mazovia, Polska MIRA- Search Pełny etat

    We are MIRA Search, an international HR agency dedicated to connecting our clients with the best professionals. We're seeking a visionary Head of Data Engineering & AI to lead and develop our teams working on core products, Olympus and Pantheon.The OpportunityAs the Head of Data Engineering & AI, you will spearhead the strategy and execution of data...

  • Data Engineering Manager

    4 tygodni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Data Engineering ManagerWe are seeking an experienced leader for the role of Data Engineering Manager. The successful candidate will provide technical leadership for data projects within a global organization, managing a team of data engineers, and developing scalable and secure data systems that enable data-driven decision-making.Key Responsibilities:Lead a...

  • Data Engineering Lead

    4 dni temu

    Warszawa, Mazovia, Polska Bunge Iberica SA Pełny etat

    Bunge is a global leader in sourcing, processing, and supplying oilseed and grain products and ingredients. Founded in 1818, Bunge's expansive network feeds and fuels a growing world, creating sustainable products and opportunities for more than 70,000 farmers and the consumers they serve across the globe.We are seeking a highly motivated and experienced...

  • Senior Technical Leader in Engineering

    6 dni temu

    Warszawa, Mazovia, Polska GE Aerospace Pełny etat

    About GE AerospaceWe are a leading innovator in the aerospace industry, driving technological advancements and pushing boundaries.Job OverviewThis role is for a highly skilled and experienced technical leader to join our team as a Senior Staff Engineer. As a key member of our engineering team, you will be responsible for executing laboratory and field...

  • Data Pipeline Engineer Leader

    5 dni temu

    Warszawa, Mazovia, Polska Capgemini Pełny etat

    We are seeking a highly skilled Data Pipeline Engineer Leader to join our team at Capgemini. As a seasoned expert in data engineering, you will be responsible for architecting, developing, and maintaining scalable data pipelines on Microsoft Azure.About the RoleWith 4+ years of experience in data engineering, you will lead the design and implementation of...

  • Engineering Manager, Engineering Team Leader

    3 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Social network you want to login/join with:Engineering Manager, Engineering Team Leader, WarsawClient:Location:Warsaw, PolandJob Category:Other-EU work permit required:YesJob Reference:6f3136a954a5Job Views:3Posted:17.03.2025Expiry Date:01.05.2025Job Description:Join our Data Acquisition team where fast and reliable information is minted out of raw data and...

  • Engineering Manager, Engineering Team Leader

    5 dni temu

    Warszawa, Mazovia, Polska Sportradar Pełny etat

    Full-timeCompany DescriptionA technology first software development company with high emphasis on achieving technical excellence and building services on best practice cloud principles. We build our own product and believe in 'you build it, you own it' paradigm, so we want to give our squads autonomy to choose the right solutions.We are NASDAQ-listed and are...

  • Market Data Technology Leader

    5 dni temu

    Warszawa, Mazovia, Polska Point72 Asset Management, L.P Pełny etat

    Job OverviewAt Point72 Asset Management, L.P., we're expanding our technology team and seeking a seasoned Market Data Technology Leader. This critical role will focus on overseeing the development and implementation of market data systems that support our trading and analytical operations.You'll work closely with our data engineering team to design, build,...

  • Data Engineering Leader

    1 dzień temu

    Warszawa, Mazovia, Polska Chaosgears Pełny etat

    Become an integral part of Chaosgears' team as a Cloud Solutions Architect and contribute to designing scalable data & AI solutions based on AWS services.Your RoleDesigning and implementing cloud architectures for data and AI solutionsOverseeing project execution and partial implementationCollaborating with clients to create solutions aligned with their...

  • Data Engineering Specialist

    2 dni temu

    Warszawa, Mazovia, Polska Atos Pełny etat

    Eviden, a global leader in digital transformation, is seeking an experienced Software/Data Engineer to join its dynamic project for a German client in the energy sector.About the RoleWe are looking for a skilled professional to design and implement cutting-edge data architectures and solutions using Kubernetes, DevOps, and DataOps methodologies.The ideal...

  • Technical Leader in Software Engineering

    1 tydzień temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    We're seeking a seasoned Technical Leader in Software Engineering to lead our Risk and Identity Solutions team. As a key member of our leadership team, you'll drive the definition of shared strategic vision for our development team and design tools and services that safeguard Visa's payment systems.About the RoleYou'll present technical solutions,...

  • Data Cloud Engineer Leader

    1 dzień temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Job Overview">Snowflake is a pioneering company in the AI Data Cloud, aiming to build a unified experience across its platform and tools. As an Engineering Manager on our Developer Platform team, you will spearhead the development of innovative solutions that enable seamless DevOps integration across applications and data platforms.">In this role, you will...

  • Software Engineering Leader

    3 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    We are looking for a talented Software Engineering Leader to join our team at TN Poland.Job Overview:The successful candidate will lead a team of 10 software engineers with different levels of expertise and manage other managers. They will work collaboratively with product owners, other leaders, and engineers to create the best product for customers within...

  • Senior Data Engineer Leader

    2 dni temu

    Warszawa, Mazovia, Polska Mastercard Pełny etat

    Welcome to MastercardWe're on a mission to make payments safe, simple, smart, and accessible. Join us as a Senior Data Engineer Leader and help us achieve our goal. As a member of the Processing Service Delivery team, you'll lead initiatives that drive business value and support the company's growth.About the RoleLeverage your knowledge and skills to deploy...

  • Cloud Engineering Leader

    5 dni temu

    Warszawa, Mazovia, Polska GOSOLVE Pełny etat

    Job DescriptionWe are looking for a Senior Go Engineer to be part of our engineering team. As a member of our team, you will be responsible for developing and maintaining tools, backend services, and APIs that power our onboarding flows and internal systems.You will work closely with other engineering teams to design, implement, and deploy new or existing...

  • Data Engineering Team Lead

    6 dni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    At Link Group, we are seeking an exceptional Data Engineering Team Lead to drive innovation and excellence in our data solutions. This is a critical role that requires technical expertise, leadership skills, and the ability to collaborate with cross-functional teams.About the RoleThe successful candidate will lead a team of data engineers, actively...

  • Data Engineer Leader

    5 dni temu

    Warszawa, Mazovia, Polska HCLTech Pełny etat

    Job OverviewHCLTech is a global technology company with over 224,000 people across 60 countries. We deliver industry-leading capabilities in digital, engineering, cloud, AI, and software, powered by a broad portfolio of technology services and products.ResponsibilitiesWe are seeking an experienced data engineer to design, build, and launch extremely...