Data Engineer with Fabric
1 dzień temu
Duties:
- Designing and implementing data processing systems using Microsoft Fabric, Azure Data Analytics, Databricks and other distributed frameworks (ex. Hadoop, Spark, Snowflake, Airflow).
- Writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
- Building data pipelines to ingest data from various sources (databases, APIs or streaming platforms).
- Integrating and transforming data to ensure its compatibility with the target data model or format.
- Designing and implementing data models that support efficient data storage, retrieval, and analysis.
- Utilizing frameworks like Spark to perform distributed computing tasks, such as parallel processing, distributed data processing, or machine learning algorithms.
- Establishing data governance practices to maintain data integrity, quality, and consistency.
- Identifying and resolving issues related to data processing, storage or infrastructure.
- Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
- Train and mentor Junior Data Engineers, providing guidance and knowledge transfer.
Requirements:
- Commercial experience working as a Data Engineer (4+ years of experience).
- Proficiency in MS Fabric, Azure Data Factory.
- Strong programming skills in Azure Databricks or Python, PySpark or Scala and Spark SQL/TSQL for data transformations.
- Extensive knowledge of MS Fabric components:
o Lakehouse, OneLake, Data Pipelines, Real-Time Analytics, Data warehouse, Power BI Integration, Semantic Models, Spark Jobs, Notebooks and Realtime Analytics, Dataflow Gen1 and Gen2, KQL.
- Integrate Fabric capabilities for seamless data flow, governance, and collaboration across teams.
- Strong understanding of Delta Lake, Parquet, and distributed data systems.
- Strong experience in implementation and management of Lakehouse using Databricks and Azure Tech stack (ADLS Gen2, ADF, Azure SQL).
- Proficiency in data integration techniques, ETL processes and data pipeline architectures.
- Solid understanding of data processing techniques such as batch processing, real-time streaming and data integration.
- Proficiency in working with relational and non-relational databases - MSSQL, MySQL, PostgreSQL or Cassandra.
- Proficient in data modeling techniques and database optimization - query optimization, indexing, and performance tuning.
- Understanding of data security best practices and experience implementing data governance policies.
- Strong problem-solving abilities to identify and resolve issues related to data processing, storage, or infrastructure.
- Analytical mindset to analyze and interpret complex datasets for meaningful insights.
- Excellent communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.
- Ability to convey technical concepts to non-technical stakeholders in a clear and concise manner.
- Nice to have:
· A bachelor's or master's degree in Computer Science, Information Systems, or a related field.
· Excellent knowledge on Source control / Version Control along with CI/CD.
· Knowledge of data warehousing concepts and technologies like Redshift, Snowflake, or BigQuery.
· Familiarity with data privacy regulations and compliance standards.
· Experience in designing and creating integration and unit test.
- Certifications:
o DP-600 (Fabric Analytics Engineer Associate) certification
o DP-700 (Microsoft Certified: Fabric Data Engineer Associate)
o DP-203 (Azure Data Engineer Associate) certification
o Databricks Associate/ Spark Developer Associate certification
We offer:
- Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
- “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
- Flexibility regarding working hours and your preferred form of contract.
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Internal Gallup Certified Strengths Coach to support your growth.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
- Modern office equipment. Purchased for you or available to borrow, depending on your location.
-
Data Engineer
6 dni temu
Warszawa, mazowieckie, Polska Semantive Pełny etatWe are an independent multi-cloud services company that helps enterprises and SMB companies build new foundations for future growth through successful cloud transformation and breadth of expertise in applying cloud technologies to unlock new possibilities. Today's digital and technological revolution is an important part of our business - we are not only...
-
Data Engineer
3 dni temu
Warszawa, mazowieckie, Polska DCG Pełny etatDCG is a modern technology company, gathering IT-related professionals in its ranks. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position of Data EngineerB2B100% Remote workThe first contract is for 2 months with the possibility of an...
-
Data Engineer
6 dni temu
Warszawa, mazowieckie, Polska LLInformatics Pełny etatLLInformatics is an IT consulting company with dozens of satisfied clients across Europe and North America. We serve businesses that expect their challenging projects to be delivered according to plan, with impeccable quality, and under strict compliance requirements. Our remote-first team of 100+ experts specializes in building high-quality digital...
-
Data Scientist
6 dni temu
Warszawa, mazowieckie, Polska Semantive Pełny etatWe are an independent multi-cloud services company that helps enterprises and SMB companies build new foundations for future growth through successful cloud transformation and breadth of expertise in applying cloud technologies to unlock new possibilities. Today's digital and technological revolution is an important part of our business - we are not only...
-
DATA Engineer
6 dni temu
Warszawa, mazowieckie, Polska PAYBACK Pełny etatPAYBACK is the world’s leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.PAYBACK is a top player in data-driven marketing. With the ability to develop...
-
Senior Data Engineer
4 dni temu
Warszawa, mazowieckie, Polska Alter Solutions Polska Pełny etatCompany DescriptionOur mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying...
-
Cloud Data Engineer
6 dni temu
Warszawa, mazowieckie, Polska PAYBACK Pełny etatPAYBACK is unique worldwide in data-based marketing. With the ability to develop digital business models and implement technical trends, we are pioneers of the data economy. The technical solutions for our 31 million customers relating to the PAYBACK program are designed and operated in-house. To this end, we work with the latest technologies and in a...
-
Data Center Equipment Manufacturing Engineer
6 dni temu
Warszawa, mazowieckie, Polska Google Pełny etatAbout the jobBe part of a diverse team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance,...
-
Data Engineer Databricks Python SQL
6 dni temu
Warszawa, mazowieckie, Polska Procter & Gamble Pełny etatWe’re looking for a Data Engineer to join our Data & Analytics Core Data Lake Platform engineering team. We are searching for self-motivated candidates, who will leverage modern Agile and DevOps practices to design, develop, test and deploy IT systems and applications, delivering global projects in multinational teams.P&G Core Data Lake Platform is a...
-
Data Engineer
2 tygodni temu
Warszawa, mazowieckie, Polska Procter & Gamble Pełny etatWe are looking for a Senior Data Engineer to join our IT Data team for Intelligent Operations in Warsaw. In this role, you will be responsible for building systems that ingest and convert IT data into usable models for business analysts, data science and machine learning solutions. You will work on data transformation and visualization leveraging various...
-
Cloud Data Engineer Snowflake
5 dni temu
Warszawa, mazowieckie, Polska Provident Polska Pełny etatWe are seeking a skilled and forward-thinking Cloud Data Engineer to play a key role in transforming our data landscape as we migrate from SQL Server to Snowflake on AWS. The successful candidate will be responsible for designing, developing, and maintaining secure, scalable data pipelines that leverage medallion architecture to enable efficient data flow...
-
DevOps Engineer with French
6 dni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatDevOps Engineer with French 100% Remote About the Role:We are seeking an experienced DevOps Engineer to join an exciting project for the European Investment Bank. This fully remote position focuses on developing and enhancing Hashicorp Vault solutions to ensure secure and efficient infrastructure operations. Key Responsibilities:Onboard new applications...
-
Big Data Engineer in Samsung Ads Project
2 tygodni temu
Warszawa, mazowieckie, Polska Samsung R&D Institute Poland Pełny etatAbout our TeamWe seek a highly skilled and motivated Big Data Engineer to join our growing Samsung Ads team. As Big Data Engineer, you will contribute to development and buildout of components of Samsung’s DSP platform.You will be closely working with local team in Warsaw, having also many opportunities of collaboration with Samsung’s remote teams across...
-
Data Engineer
6 dni temu
Warszawa, mazowieckie, Polska InPost Pełny etatAs you probably know, there is a lot going on at InPost! The main core of our business are Parcel Locker devices, which we have been manufacturing and designing in-house for years. In addition, we are constantly developing our portfolio of services and introducing new solutions, such as InPost Fresh, Fulfillment or InPost Pay, making life easier for millions...
-
Data Engineer at Haptiq
5 dni temu
Warszawa, mazowieckie, Polska On The Spot Development Pełny etatHaptiq is a global technology company dedicated to delivering best in class software and digital solutions engineered to drive profitable and scalable growth for our clients.Operating as the nexus of portfolio management, growth, and optimization, Haptiq offers SaaS platforms fueled by cutting-edge AI, a comprehensive end-to-end data management platform, and...
-
Cloud Data Engineer Snowflake
6 dni temu
Warszawa, mazowieckie, Polska Michael Page International Sp. z o.o. Pełny etatAbout Our ClientCompany Information: Our client is a Dutch-British multinational with 9,000 employees worldwide. With expertise in compliance, accounting, payroll, and corporate secretarial services, they assist their clients in understanding and adhering to local laws, regulations, and business practices across the globe.Job DescriptionDetailed Job...
-
Network & Systems Engineer
6 dni temu
Warszawa, mazowieckie, Polska Voltage Park Pełny etatVoltage Park is building a cloud infrastructure business from the ground up. As part of this effort, we’re hiring a Network & Systems Engineer to be responsible for building and supporting our AI Data Center network/compute/storage environment. To succeed in this role, you will need to be comfortable owning deployment and troubleshooting tasks covering...
-
Warszawa, mazowieckie, Polska Google Pełny etatAbout the jobThe Google Cloud team helps companies, schools, and government seamlessly make the switch to Google products and supports them along the way. You listen to the customer and swiftly problem-solve technical issues to show how our products can make businesses more productive, collaborative, and innovative. You work closely with a cross-functional...
-
Machine Learning Engineer
6 dni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe are looking for a skilled Machine Learning Engineer to join our team, focusing on the development and maintenance of a Retrieval-Augmented Generation (RAG) system for internal client use. This role blends data science and backend development, with a strong emphasis on experimenting with advanced ML models.Responsibilities:Analyze and experiment with...
-
Senior MLOps Engineer
6 dni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe are seeking a Senior MLOps Engineer with a strong background in machine learning and data science. The ideal candidate will have experience in developing and deploying applications that leverage large language models (LLMs), with a focus on agentic design and automation within the MLOps pipeline.Key responsibilities:Design, build, and optimize ML and data...