Lead Data Engineer

Join an AI native data engineering team as a
Lead Data Engineer (Snowflake, Airflow)
focused on building a quantitative investment platform.

Apply your expertise to shape data solutions that enhance investment decision-making.

This role requires working 5 days a week from our office in Krakow or Gdansk.

Responsibilities

• Identify and integrate diverse data sources including structured, unstructured, and semi-structured data
• Implement role-based access control and develop logical data models ensuring compliance and data lineage
• Document business transformations and establish data quality approaches and rules
• Create and maintain a comprehensive data catalog with metadata focusing on data sensitivity and security
• Translate architectural blueprints into implementations for data acquisition, preparation, and consumption
• Ensure data management and quality standards to support automated investment processes
• Apply data sharding concepts to optimize data architecture
• Develop a Neo4j-powered knowledge graph as the central data layer for investment intelligence
• Link research, strategies, and portfolio actions into a lineage graph for decision traceability
• Develop and maintain a multi-dimensional asset ontology for flexible categorization and analysis
• Integrate temporal versioning to enable time-aware queries and preserve historical context
• Incorporate GraphRAG to transform unstructured documents into queryable graph entities with source attribution
• Implement property-based access control for secure multi-tenant data visibility and query protection
• Oversee real-time data ingestion pipelines for multiple data types
• Lead the development of scalable data warehousing solutions using Snowflake
• Establish strategic frameworks for data quality and governance across the platform

Requirements

• Proficiency in Snowflake and Apache Airflow with 5+ years of experience
• Expertise in graph data structures and Graph RAG technology
• Strong background in data architecture and design with experience in market data sources
• Experience integrating AI-driven and assisted architectures
• Ability to share knowledge on Cypher, graph traversal, and RAG with teams
• Competency in implementing role-based and property-based access controls
• Experience managing real-time data ingestion pipelines
• Proficiency in documenting data transformations and quality rules
• Skilled in developing data catalogs, including metadata and sensitivity considerations
• Strong written and verbal English communication skills (B2+)

Nice to have

• Skills in AWS cloud-based solutions

We offer

• We gather like-minded people:
• Engineering community of industry professionals
• Friendly team and enjoyable working environment
• Flexible schedule and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities
• We provide growth opportunities:
• Outstanding career roadmap
• Leadership development, career advising, soft skills, and well-being programs
• Certification (GCP, Azure, AWS)
• Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
• English classes
• We cover it all:
• Stable income (Employment Contract or B2B)
• Participation in the Employee Stock Purchase Plan
• Benefits package (health insurance, multisport, shopping vouchers)
• Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
• Referral bonuses
• Corporate, social and well-being events
• Please, note:
• The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.
• We will reach out to selected candidates exclusively.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.