Data Engineer

2 tygodni temu

Kraków, Lesser Poland DataArt Solutions, Inc Pełny etat

Our client specializes in manufacturing equipment for industrial automation.

Join a great company, not merely an individual project

Position overview

Role will primarily involve managing the data flow from robots to data pipelines, data warehousing and automating existing infrastructure. The ideal candidate will be highly proficient in AWS data components management and Infrastructure as Code (IaC) technologies.

Responsibilities
  • Automate and orchestrate data flow between devices and both AWS and GCP
  • Implement data warehousing solutions on AWS
  • Manage AWS data components, such as Kinesis Data Stream, Kinesis Firehose, S3 Bucket, Lambda, Greengrass IoT Core, Timestream, and Athena
  • Optimize the AWS infrastructure for cost, latency, reliability, and management
  • Develop and maintain comprehensive documentation of cloud infrastructure setup, policies, standards, and guidelines
  • Implement Infrastructure as Code (IaC) for reliable and repeatable infrastructure deployment
Requirements
  • 5+ years of experience in data engineering, specifically with managing data from multiple devices
  • Proficient knowledge of AWS services, particularly Kinesis Data Stream, Kinesis Firehose, S3 Bucket, Lambda, Greengrass IoT Core, Timestream, and Athena
  • Experience with Infrastructure as Code (IaC) technologies like Terraform or AWS CDK
  • Experience with handling data flow and data warehousing
  • Proficiency in programming languages relevant to data engineering such as Python
  • Familiarity with Quality Control and Test Automation practices
Nice to have
  • Relevant AWS or GCP certifications, as well as experience in the robotics or hardware industry

As per the laws of your country. We do ask you to take a proper rest

Health insurance

We help you to take out an insurance policy for you and your loved ones

Sick pay

10 days without a doctor's note, afterwards - as per the laws of your country

According to the official calendar, regardless of the client's schedule

Pleasant environment

Two large corporate parties and many small get-togethers for colleagues

Comfort service

Solving technical and everyday problems at work

The benefits package may vary depending on the region and the type of contract

What if I can't find it?

Our vacancies are swept up like hotcakes. If you don't find any vacancies that match your skills, let us know and we'll try to help

Most wanted

Data Architect, Professional Certification

The project aims to improve product catalog management and update our data infrastructure by migrating to AWS.

Senior Data Architect

As a Solution Architect for our Data & Analytics Competence, you will be instrumental in shaping and executing our data governance strategy, ensuring the quality, security, and compliance of our data assets.

Client's key technology driver for the nearest period is migration to the AWS Cloud with strong emphasis on serverless solutions.

Subscribe so you don't miss anything important

#J-18808-Ljbffr

  • Data Engineer III

    2 tygodni temu

    Kraków, Lesser Poland FedEx Pełny etat

    The Data Engineer III - Driving Innovation Within DataworksActing as a key player in Dataworks, the Data Engineer III is essential for defining the organization, leading business initiatives, and fostering engineering innovationServing as a 'universal translator', bridging IT, business, software engineers, and data scientists to drive collaboration and...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Schibsted Pełny etat

    Passionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Data EngineerAds Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media ́s Nordic advertising organisation, representing some of the strongest brands...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Position PurposeThe Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland INUITS bvba Pełny etat

    Embark on a journey with Hypersonix AI as we search for a proficient Data Engineer to enhance their advanced AI Platform. ProfitGPT empowers enterprises with actionable insights derived from their vast array of databases and application systems. Intrigued? Read on for more details.Hypersonix specializes in creating an AI-driven platform that turns vast...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N-iX Pełny etat

    Senior Data Engineer @ N-iX Kraków, Lesser Poland Voivodeship About our customer:The OVO Group's mission is to drive progress towards net zero carbon living. We're a collection of companies with a single vision: to power human progress with clean affordable energy for everyone. About the role:If you are a Senior Data Engineer with a passion for building...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Sigma Software Pełny etat

    Senior Data Engineer (IT Solutions) @ Sigma Software Kraków, Lesser Poland Voivodeship Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMERSigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to...

  • Data DevOps Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Pełny etat

    Company Description We are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day. Our culture is bursting with energy and ambition where we generate intense moments of Spannung,...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N Consulting Ltd Pełny etat

    Location: Wroclaw, Poland(Hybrid) Experience:05 to 12 years Responsibility: • create and implement highly scalable and reliable data distribution solution using VQL, Python, Spark & open-source technologies, to deliver data tobusiness components.• work with Denodo, ADLS, Databricks, Kafka, data modelling, data replication, clustering, SQL Query patterns...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N Consulting Ltd Pełny etat

    Location:Wroclaw, Poland (Travel 3 times a week)Experience:5 to 12 yearsResponsibility:Create and implement highly scalable and reliable data distribution solution using VQL, Python, Spark & open-source technologies, to deliver data to business components.Work with Denodo, ADLS, Databricks, Kafka, data modelling, data replication, clustering, SQL Query...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tesco Technology Pełny etat

    Job DescriptionThe Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities including:Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.Managing critical data related to customer...

  • Data DevOps Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Group Pełny etat

    Job Family: DataCompany DescriptionWe are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day.Our culture is bursting with energy and ambition where we generate intense moments of...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Rite NRG Pełny etat

    Senior Data Engineer Kraków, Województwo małopolskie Senior Data Engineer Kraków Kraków, Małopolskie, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Group Pełny etat

    Job Family: DataCompany DescriptionWe are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day.Our culture is bursting with energy and ambition where we generate intense moments...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland DCV Global Recruitment Pełny etat

    Experienced in Scala, Python or Java and Unix/Linux environment on-premisesExperience with developing RESTful APIs using Java Spring BootHands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Schibsted Pełny etat

    Passionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Senior Data Engineer ABOUT USAds Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media ́s Nordic advertising organisation, representing some of the...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Commerzbank Ag Pełny etat

    Technologies-expected : SQL Git Google Cloud Platform about-project : In your role as a Data Engineer you will be working in the Data as a Service (Daa S) cell which builds products and services designed to provide barrier free, easy to use information and test data for the whole bank.This includes data anonymization services, user interfaces and a...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Maxima Europe Sp. Z.o.o. Pełny etat

    Technologies-expected : Databricks Azure Data Factory SQL Py Spark technologies-optional : Azure Analysis Services about-project : We are seeking a skilled Data Engineer to join our team.The ideal candidate will have strong experience in Databricks, Azure Data Factory (ADF), SQL, Py Spark, and Continuous Integration/Continuous Deployment (CI/CD).Experience...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Software Mind Pełny etat

    [GZI] Senior Data Engineer Full-time Company Description Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that...

  • Data / Platform Engineer

    2 tygodni temu

    Kraków, Lesser Poland Mindbox S.a. Pełny etat

    Job Description: Technologies-expected: Spark, Python, Scala, Google Cloud Platform About the Project: Seeking an experienced Data/Platform Engineer to assist in development, analysis, and maintenance of data processes on GCP-managed platforms. Responsibilities: Analysis and refactoring of data engineering pipelines Migration of processes between...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Gpc Global Technology Center Pełny etat

    Technologies-expected : Data Bricks SQL Python Power BI about-project : The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines.The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop...