Praca dla data engineer w Krakow

About the role The Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities, including: Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency. Managing critical data related to...

- At least 3 years of commercial experience in data engineering or a related role. - Hands-on commercial experience with Databricks - this is a mandatory requirement. - Strong experience with Microsoft Azure data services, including Azure Data Lake and cloud-based data integration. - Experience with Microsoft Fabric and its data engineering capabilities. -...

Technical - Experience handling large-scale datasets and distributed systems in production environments - Proven ability to optimise low-latency, high-volume queries and processes - Strong scripting and software engineering skills: Python, Bash; Git for version control - Practical knowledge of Unix/Linux environments , CI/CD automation, and deployment...

Company at a GlanceOpenX is focused on unleashing the full economic potential of digital media companies. We do this by making digital advertising markets and technologies that are designed to deliver optimal value to publishers and advertisers on every ad served across all screens.At OpenX, we have built a team that is uniquely experienced in designing and...

MAKE HISTORY WITH US   At PMI, we’ve chosen to do something incredible. We’re totally transforming our business and building our future on smoke-free products with the power to deliver a smoke-free future. With huge change comes huge opportunity. Wherever you join us, you’ll enjoy the freedom to dream up and deliver better, brighter solutions, and...

Overview Principal Data Engineer We’re Kingfisher, a team made up of over 74,000 passionate people who bring Kingfisher - and all our other brands: Castorama, B&Q, Screwfix, Brico Dépôt and Koçtaş - to life. That’s right, we’re big, but we have ambitions to become even bigger and even better. We want to become the leading home...

We are looking for a Senior Data Engineer with specialized domain expertise in fraud detection, Anti-Money Laundering (AML), or transaction-monitoring systems to establish data-quality foundations for decision engines. Our client is a fast-growing European FinTech company in the Business Spend Management space - providing corporate cards and related...

YOUR PROFILE - Proven experience in Big Data or Cloud projects involving processing and visualization of large and unstructured datasets, across various phases of the SDLC. - Hands-on experience with the AWS cloud, including Storage, Compute (and Serverless), Networking, and DevOps services. - Solid understanding of AWS services, ideally supported by...

- 7+ years of commercial experience as a Data Engineer - Strong SQL, Python - Experience with data modelling - Understanding of data warehousing, data lakes and data lakehouse architectures - Hands-on experience with GCP data engineering tools - Very good knowledge of BigQuery - Experience with DBT, Airflow and Trino - Understanding of CI/CD principles and...

Must-have skills - 8+ years of professional experience in Data Engineering, Software Engineering, or a closely related field. - Strong, hands-on commercial experience with Azure Databricks . - Very good knowledge of the Azure cloud ecosystem and cloud-based data architectures. - Excellent programming skills in Python – we are looking for a strong coder,...

- At least 8 years of commercial experience as a Data Engineer, Lead Data Engineer, or Data Architect - Strong expertise in SQL - Strong expertise in Python - Strong expertise in Spark or PySpark - Experience in data architecture, data quality, metadata management, analytics, and reporting - Strong experience with cloud data engineering tools, preferably...

- Strong experience with Azure Cloud Infrastructure and Platform Engineering . - Expertise in Azure networking, identity, compute, and storage services. - Skilled with Infrastructure-as-Code (Terraform), automation tools (Ansible, ARM). - Exposure to Azure Data Factory, Databricks, Event Hubs, Kubernetes , and big data platforms. - Proficiency with Linux,...

What you'll need to succeed in this role: - At least 3 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance and data management processes. - Strong programming skills in Python (or Java/Scala): writing a clean code, OOP design. - Hands-on with Big Data technologies like Spark , Cloudera, Data Platform,...

What you'll need to succeed in this role: - At least 3 years of commercial experience implementing, developing, or maintaining Big Data systems. - Strong programming skills in Python : writing a clean code, OOP design. - Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions. - Experience in...

- At least 10 years of experience in software design, data engineering and development in Agile and DevOps environments - Strong development and solution design experience with PySpark or Scala - Hands-on experience with Google Cloud Platform and building data pipelines in GCP - Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce and ETL...

- A strong analytical mindset and a passion for solving complex data engineering challenges - Solid computer science fundamentals or experience with functional programming languages (Haskell, Clojure, Scala) OR vectorization skills in Python, R, Matlab, or Wolfram - Interest in large datasets, data modeling, and statistical concepts - Familiarity or...

- Strong experience with Python and SQL. - Knowledge of Google Cloud tools : Cloud Storage (buckets), BigQuery (BQ), Composer/Apache Airflow. - Familiarity with PySpark is a plus. - Solid background in building Data Lakes, DWHs , and working with Star Schema / Snowflake designs . - Proven experience in delivering production-grade data pipelines with best...

- Strong hands-on experience with PySpark (DataFrame APIs, tuning, debugging). - Practical knowledge of Apache Iceberg , including: - Optimisation techniques (partitioning strategy, file sizing, layout). - Internal architecture understanding (snapshots, manifests, schema evolution). - Maintenance operations (rewrite/compaction, orphan file cleanup, metadata...

You will need Mandatory skills: - Data Processing: Apache Spark - Scala or Python - Data Storage: Apache HDFS, CEPH S3 or respective cloud alternative - Resource Manager: Apache Yarn or respective cloud alternative - Lakehouse: Apache Hive/Kyuubi or alternative - Workflow Scheduler: Airflow or alternative Nice to have skills: - Functional programming -...

Technical / Specialized Knowledge, Skills, and Abilities - Strong hands-on experience with Snowflake, including data modelling, performance tuning, cost optimization, clustering or dynamic tables, and Snowflake-native security and governance features. - Solid Power BI proficiency: building semantic models (DAX, Power Query), enterprise report design,...