Senior Data Engineer

Senior Data Engineer (with Snowflake)Miejsce pracy: BiałystokTechnologies we useExpectedPythonSnowflake Data CloudAmazon AWSSQLYour responsibilitiesDesign, build, and maintain scalable data pipelines (ETL/ELT) leveraging Snowflake and AirflowImplement optimized schemas, partitioning, and indexing strategies in Snowflake and relational databasesDevelop data processing workflows and automation scripts in Python and SQL; integrate with APIs and microservicesEnsure scalability, performance, and resilience of pipelines; implement observability for jobs and data flowsPartner with data scientists and ML engineers to deliver high-quality datasets optimized for AI/ML workloadsPrepare, transform, and manage datasets for embeddings, RAG workflows, and LLM fine-tuningOur requirementsExperience: A minimum of 5-7+ years in data engineering, preferably supporting AI/ML applications and hold B.Sc., B.Eng., or higher, or equivalent in Computer Science, Data Engineering or related fieldsExperience with SnowflakeProgramming: Proficiency in Python, SQL and vector database native languagesDatabases: Experience with relational databasesCloud Platforms: Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation)ETL/ELT Pipelines: Experience building scalable ETL/ELT workflows using dbt, Apache Airflow, or similarAPIs & Microservices: Ability to design and integrate RESTful APIs for data exchangeData Security & Governance: Understanding of encryption and role-based access controlsVersion Control & DevOps: Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation)Generative AI Support: Experience working with AI-specific data needs, such as embeddings, RAG (Retrieval Augmented Generation), and LLM fine-tuning data preparationOptionalNoSQL, vector databasesIoT data streaming (Kafka, Kinesis, PySpark etc).This is how we organize our workThis is how we workat the client's siteyou focus on a single project at a timeagileWhat we offerFlexible forms of employment and working hours (CoE or B2B)An interesting, challenging job in the dynamically developing Capital Group company;Work on innovative projects using modern technologies;Direct impact on shaping the image of the Capital Group's companies on the market;Possibility to develop competences in a wide range;Attractive salary;Stability of employment and a friendly work atmosphere;Cool benefits, among others integration meetings, internal company competitions, fruit Tuesdays, sweet Thursdays and much more;Benefitsprivate medical caresharing the costs of foreign language classessharing the costs of professional training & courseslife insuranceremote work opportunitiesflexible working timefruitsintegration eventsno dress codevideo games at workcoffee / tealeisure zoneholiday fundsbaby layettechristmas giftsbirthday celebrationsharing the costs of a streaming platform subscriptionemployee referral programcharity initiativesfamily picnicsTRANSITION TECHNOLOGIES PSC S.ATransition Technologies PSC specializes in creating IT solutions for the industry. Particularly Connected Product Lifecycle Management, application in the industry of the latest technologies of Internet of Things (IoT) and Augmented Reality (AR), thanks to which our clients can implement the concept of Industry 4.0. Our company is more than 500 enthusiasts of programming, technological innovations and programming methodologies who in their work are always guided by mutual help, good atmosphere and creative approach.Wszystkie informacje o przetwarzaniu danych osobowych w tej rekrutacji znajdziesz w formularzu aplikacyjnym, po kliknięciu w przycisk "Aplikuj Teraz".