Senior Data Engineer

Senior Data Engineer (with Snowflake) Miejsce pracy: Poznań Technologies we use Expected Python Snowflake Data Cloud Amazon AWS SQL Your responsibilities Design, build, and maintain scalable data pipelines (ETL/ELT) leveraging Snowflake and Airflow Implement optimized schemas, partitioning, and indexing strategies in Snowflake and relational databases Develop data processing workflows and automation scripts in Python and SQL; integrate with APIs and microservices Ensure scalability, performance, and resilience of pipelines; implement observability for jobs and data flows Partner with data scientists and ML engineers to deliver high-quality datasets optimized for AI/ML workloads Prepare, transform, and manage datasets for embeddings, RAG workflows, and LLM fine-tuning Our requirements Experience: A minimum of 5-7 years in data engineering, preferably supporting AI/ML applications and hold B.Sc., B.Eng., or higher, or equivalent in Computer Science, Data Engineering or related fields Experience with Snowflake Programming: Proficiency in Python, SQL and vector database native languages Databases: Experience with relational databases Cloud Platforms: Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation) ETL/ELT Pipelines: Experience building scalable ETL/ELT workflows using dbt, Apache Airflow, or similar APIs & Microservices: Ability to design and integrate RESTful APIs for data exchange Data Security & Governance: Understanding of encryption and role-based access controls Version Control & DevOps: Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation) Generative AI Support: Experience working with AI-specific data needs, such as embeddings, RAG (Retrieval Augmented Generation), and LLM fine-tuning data preparation Optional NoSQL, vector databases IoT data streaming (Kafka, Kinesis, PySpark etc). This is how we organize our work This is how we work at the client's site you focus on a single project at a time agile What we offer Flexible forms of employment and working hours (CoE or B2B) An interesting, challenging job in the dynamically developing Capital Group company; Work on innovative projects using modern technologies; Direct impact on shaping the image of the Capital Group's companies on the market; Possibility to develop competences in a wide range; Attractive salary; Stability of employment and a friendly work atmosphere; Cool benefits, among others integration meetings, internal company competitions, fruit Tuesdays, sweet Thursdays and much more; Benefits private medical care sharing the costs of foreign language classes sharing the costs of professional training & courses life insurance remote work opportunities flexible working time fruits integration events no dress code video games at work coffee / tea leisure zone holiday funds baby layette christmas gifts birthday celebration sharing the costs of a streaming platform subscription employee referral program charity initiatives family picnics TRANSITION TECHNOLOGIES PSC S.A Transition Technologies PSC specializes in creating IT solutions for the industry. Particularly Connected Product Lifecycle Management, application in the industry of the latest technologies of Internet of Things (IoT) and Augmented Reality (AR), thanks to which our clients can implement the concept of Industry 4.0. Our company is more than 500 enthusiasts of programming, technological innovations and programming methodologies who in their work are always guided by mutual help, good atmosphere and creative approach. Wszystkie informacje o przetwarzaniu danych osobowych w tej rekrutacji znajdziesz w formularzu aplikacyjnym, po kliknięciu w przycisk "Aplikuj Teraz".