Senior Data Engineer
3 tygodni temu
Senior Data Engineer (AI solutions)
93_8452
Obowiązki
- Collaborate with AI engineers, data scientists, product owners, and other developers in Agile teams to integrate LLMs into scalable, robust, fair and ethical end-user applications, focusing on user experience, relevance, and real-time performance
- Design and implement scalable, high-performance data pipelines for AI/GenAI applications, ensuring efficient data ingestion, transformation, storage and retrieval; integrate different databases, requiring understanding of data architectures / Domain data ecosystem
- Work with vector databases (e.g., AWS OpenSearch or Azure AI Search) to store and retrieve high-dimensional data for Generative AI workloads
- Build and maintain cloud-based data solutions using AWS OpenSearch, S3 or Azure AI Search, Azure Blob Storage
- Design and optimize data storage and processing using Snowflake for scalable, cloud-native analytics solutions
- Develop ETL/ELT pipelines to enable real-time and batch data processing
- Collaborate with AI/ML Engineers and Data Scientists to ensure seamless integration of data pipelines with AI finetuning, inference and training workflows
- Optimize data storage, retrieval, and processing strategies for efficiency, scalability, and cost-effectiveness
- Implement data governance, security best practices, and compliance measures aligned with standards
- Set up monitoring, alerting, and logging for data pipelines, ensuring high availability and reliability
Wymagania
- 3+ years of experience in data engineering, preferably supporting AI/ML applications
- Proficiency in Python, SQL and vector database native languages
- Experience with relational, NoSQL, vector databases, and Snowflake (pref)
- Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation)
- Experience building scalable ETL/ELT workflows using dbt, Apache Airflow
- Understanding of encryption and access controls
- Familiarity with Git, CI/CD, Docker, Kubernetes, Terraform and CloudFormation
- Experience working with AI-specific data needs (embeddings, RAG) and LLM fine-tuning data preparation
- Excellent analytical skills and the ability to handle complex challenges with innovative solutions
- Sc., B.Eng. (or higher) in Computer Science, Data Engineering or related fields
- Team-oriented, proactive, and collaborative
- Excellent verbal and written communication skills (in English and Polish)
Oferujemy
- Ability to design and integrate RESTful APIs
Źródło: 7n/Praca
Aplikuj
-
Senior Data Engineer @
2 tygodni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...
-
Senior Data Engineer Position
1 tydzień temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth.Our client is the market-leading intelligence platform for paid search advertising. The unique combination of artificial search...
-
Data Engineer Role
1 tydzień temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatJob DescriptionWe are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing complex data systems, working closely with the Data Science team to deliver machine learning models into production environments.You will have experience with distributed technologies, including Hadoop,...
-
Experienced Data Engineer Wanted
1 tydzień temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The successful candidate will have a strong understanding of data structures and algorithms, experience with Spark Jobs, and knowledge of cloud technologies.As a Data Engineer, you will be responsible for designing and implementing complex data systems,...
-
Senior Data Engineer in Cloud and Big Data Technologies
2 tygodni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout UsData Science UA is a company that specializes in providing data science and AI services to its clients. Our mission is to help businesses make informed decisions by leveraging the power of data and artificial intelligence. With a strong focus on innovation and customer satisfaction, we strive to be the go-to partner for organizations seeking to...
-
Data Engineer Position
7 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the Company: Data Science UA is a leading service company with a strong focus on data science and artificial intelligence expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, laying the foundation for our growth over the past eight years. We have fostered the largest Data Science Community in Eastern...
-
Senior Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska TransferGo Pełny etatSenior Data EngineerWarszawaWarsaw, Masovian Voivodeship, PolskaJoin us on our journey as a Senior Data Engineer to play a pivotal role in shaping how money is sent worldwide. You will work in a team of bright-minded individuals looking after data delivery on time for a wide range of questions. If you want to significantly impact the fintech industry, drive...
-
Senior Cloud Data Engineer
4 dni temu
Warszawa, Mazovia, Polska PeopleScout Pełny etatSenior Cloud Data EngineerPeopleReadyJob Title – Senior Cloud Data EngineerLocation – Remote, Poland We are looking for a Senior Cloud Data Engineer to join our team of data experts. This person is responsible for expanding and optimizing our Data Lake and Data Warehouse architecture and optimizing for cost and performance. The ideal candidate is...
-
Senior Data Scientist Role
7 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatJob Overview: Data Science UA is looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will have commercial experience developing Spark Jobs using Scala and Java, and experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3) and designing data models and data warehouses. Strong...
-
Senior Data Engineer
3 tygodni temu
Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etatSenior Data Engineer (finance)lokalizacja: Warszawa (mazowieckie)numer referencyjny: 1192369/jobs.plHays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market.Join the group of 500 satisfied Contractors working for Hays' clientsFor our Client we are currently looking for...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Levi Strauss Poland Sp. z o.o. Pełny etatAt Levi Strauss Poland Sp. z o.o., we're shaping the future of fashion with data-driven innovation.We're looking for a seasoned Senior Data Engineer to join our dynamic Retail Data Domain team, leading the charge in transforming the fashion industry through groundbreaking solutions.About the RoleArchitect and design high-performance data pipelines and ETL...
-
Senior Data Solutions Engineer
2 dni temu
Warszawa, Mazovia, Polska Addepto Pełny etatAbout the RoleWe are looking for a highly skilled Senior Data Engineer to join our team at Addepto. As a Senior Data Engineer, you will have the opportunity to work on challenging projects, design and develop innovative data solutions, and collaborate with our team of technology experts. The successful candidate will have a strong background in Big Data...
-
Senior Data Engineer
1 tydzień temu
Warszawa, Mazovia, Polska TransferGo Pełny etatTransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. With a team of more than 400 employees across the UK/Europe, we now support 8 million customers, building a product that truly impacts lives and...
-
Senior Data Engineer
1 tydzień temu
Warszawa, Mazovia, Polska RATA TRANSPORTATION LLC Pełny etatTransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. With a team of more than 400 employees across the UK/Europe, we now support 8 million customers, building a product that truly impacts lives and...
-
Senior Data Engineer
7 dni temu
Warszawa, Mazovia, Polska HCL Poland Pełny etatAbout the RoleWe are seeking an experienced Senior Data Engineer to join our team at HCL Poland. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines using advanced SQL and Python. You will also lead teams of Data Engineers to deliver projects of increasing complexity and dependencies.Key Responsibilities:Design...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Cyclad Pełny etatIn Cyclad we work with top international IT companies to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking a Senior Data Engineer to join our customers, a leading company in consulting, technology services, and digital transformation.Project information:Office Location: Warsaw,...
-
Senior Data Platform Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Infoplus Technologies UK Limited Pełny etatWe are searching for a highly skilled Senior Data Platform Engineer to join our team at Infoplus Technologies UK Limited.About the RoleThis contract position requires a mid-senior level candidate with a strong background in data engineering and expertise in Databricks and related technologies.Main ResponsibilitiesDesign and develop data engineering solutions...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatSenior Data Engineer - Backend Developer with GCPThe project focuses on designing, developing, and optimizing data pipelines and architectures for clinical research and AI model training.Your responsibilitiesEnsuring data quality, accuracy, and integrity by continuously monitoring and optimizing ETL processesEstablishing a seamless data flow from endpoint...
-
Senior Data Engineer
1 dzień temu
Warszawa, Mazovia, Polska Point72 Careers Pełny etatAbout the RoleWe are seeking an experienced Senior Data Engineer to lead our Data Platform team in building a multitenant data platform that onboards internal and external data sources. The successful candidate will have expertise in designing and implementing scalable and maintainable data pipelines using cloud technologies.Key ResponsibilitiesDesign and...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Alter Solutions Group Pełny etatWe are Alter Solutions Group, a leading provider of IT services, committed to delivering exceptional solutions to clients worldwide. Our mission is to match client needs with employee skills and aspirations, ensuring a satisfying experience for all. Join us as we start your adventure.Job DescriptionThe Senior Data Engineer position offers an exciting...