Data Engineer Python R Prompt Engineering

4 tygodni temu


Jesionowa Katowice, Polska MPC Pełny etat

Job Title: Data Engineer Python R Prompt Engineering

We are seeking a skilled Data Engineer with expertise in Python, R, and Prompt Engineering to join our team. As a Data Engineer, you will be responsible for developing and maintaining automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data sources.

Key Responsibilities:

  • Develop and optimize prompt-engineering scripts and semi-automatic flagging/review systems to clean, validate, and standardize metadata for various product fields.
  • Create and optimize prompts/scripts to automatically clean, categorize, and tag product metadata.
  • Write scripts to handle data cleanup for brands, prices, sizes, and availability.
  • Develop systems for manual review of flagged items in the data warehouse (DW).
  • Ensure proper merging of products by identifying and consolidating duplicates using UPCs and metadata.

Requirements:

  • 3+ years of experience as a Data Engineer or in a similar role.
  • Strong proficiency in Python (Mid/Senior level), R (Mid/Senior level), and experience with Java is a plus.
  • Experience with NLP techniques, especially in prompt engineering for data automation.
  • Proficient in designing and optimizing ETL pipelines and working with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).
  • Familiarity with product metadata structures and experience working with large datasets in a commercial environment.
  • Excellent problem-solving skills and attention to detail, especially in data validation and error handling.
  • Strong communication skills to work effectively with cross-functional teams, including QA, backend developers, and product managers (English and Polish B2 + is a must).

Benefits:

  • 25 days of paid leave for B2B or contract services;
  • Flexible working hours, with the option to work remotely or from the office;
  • Private healthcare (Luxmed);
  • Subsidy for insurance (Warta);
  • MPCharity: a program where you can propose initiatives that you would like to support.

About Us:

We are a Katowice-based IT company with over 100 people on board—and one dog. We have greatly diversified our operations, and despite the pandemic, we've experienced the most growth in the past few years. Our work focuses on our own product, getzendo.io, collaboration with a client from the United States, and a software house division (providing IT services to external companies).

Recruitment Process:

Step 1: A 45-minute interview with an HR representative (you will receive information about the project, and we will ask a few basic questions);

Step 2: Technical Interview (about 1-1.5h)

Step 3: Final interview with Product Owner (1h)



  • Jesionowa , Katowice, Polska MPC Pełny etat

    Job Title: Senior Data Automation EngineerWe are seeking a highly skilled Data Automation Engineer to join our team at MPC. As a key member of our engineering team, you will be responsible for designing and implementing automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data sources.Responsibilities:Develop...


  • Katowice, Silesia, Polska Massive Pixel Creation Pełny etat

    Project OverviewWe're developing a mobile app to compare prices across stores in the United States, providing real-time insights for consumers. To enhance quality and automate data processing, we're seeking a talented Data Engineer with expertise in Prompt Engineering.ResponsibilitiesDevelop and maintain prompt-engineering scripts to clean and standardize...


  • Katowice, Silesia, Polska Massive Pixel Creation Pełny etat

    Project OverviewWe are developing a mobile application that allows users to compare prices of the same products across different stores in the United States. Our goal is to provide consumers with real-time insights into product availability, pricing, and brand choices, helping them make more informed shopping decisions.Key ResponsibilitiesAs a Data Engineer,...


  • Katowice, Silesia, Polska Massive Pixel Creation Pełny etat

    Job Title: NLP Data Automation SpecialistWe are seeking a highly skilled NLP Data Automation Specialist to join our team at Massive Pixel Creation. As a key member of our data engineering team, you will be responsible for developing and maintaining automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is a leading energy company seeking a talented Senior Data Engineer to join our Analytics Hub team. As a key member of our team, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions using Microsoft Azure technology stack.Key Responsibilities:Building and deploying scalable and reliable...


  • Katowice, Silesia, Polska ING Pełny etat

    About the Role:We are seeking a highly skilled Data Infrastructure Engineer to join our Analytics Engineering team at ING. As a key member of our team, you will be responsible for building and maintaining a platform that supports our data analytics needs.Key Responsibilities:Design and implement a scalable and secure data infrastructureMaintain and improve...

  • Senior Data Engineer

    3 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleWe are seeking a skilled Data Engineer to join our Analytics Hub team!Key ResponsibilitiesDesign, develop, and maintain end-to-end analytics solutions using scalable and reliable architectures.Collaborate with the business to identify requirements and deliver tailored solutions.Develop and maintain data pipelines and ETL processes to ingest,...

  • Machine Learning Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Data Reply Pełny etat

    Job DescriptionWe are seeking a highly skilled Machine Learning Engineer to join our team at Data Reply. As a key member of our team, you will be responsible for designing, developing, and implementing complex machine learning solutions that drive business value for our clients.Key Responsibilities:Design and develop scalable and efficient machine learning...

  • Senior Data Engineer

    4 tygodni temu


    Zabrska , Katowice, Polska ING Hubs Poland Pełny etat

    We are seeking a skilled Data Engineer to join our team at ING Hubs Poland. As a Data Engineer, you will be responsible for designing and building data pipelines that cater to stakeholder requirements. Your day-to-day activities will involve implementing new features in Kedro/PySpark, testing them in Apache Airflow, and deploying them in our in-house...

  • Senior Data Engineer

    3 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions that are scalable, reliable, and efficient.Key ResponsibilitiesDesign and implement data pipelines using various technologies such as...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a Senior Data Engineer to join our Analytics Hub team. As a key member of our team, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions that meet the needs of our business.Key ResponsibilitiesDesign and develop scalable and reliable data pipelines and ETL processesPerform data...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes that ingest, transform, and...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes that ingest, transform, and...


  • Katowice, Silesia, Polska SILVERHAND Pełny etat

    Job Title: Software EngineerJob Summary:We are seeking a skilled Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining our software applications using Python and related technologies.Key Responsibilities:• Develop and implement software applications using Python and...


  • Katowice, Silesia, Polska ING Pełny etat

    We are looking for a highly skilled Data Engineer to join our team at ING. This is an exciting opportunity to grow and develop your career in data engineering.As a Data Engineer, you will be responsible for the development and administration of BI tools, including Power BI and other reporting tools. You will also create business requirements to define...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience building complex data pipelines,have experience with Apache Airflow, Spark, Python,have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),have experience with deployment and provisioning automation tools...


  • Katowice, Polska ING Hubs Poland Pełny etat

    We are seeking an experienced Data Workflow Engineer IV to join our Financial Markets & Group Treasury team at ING Hubs Poland.**Job Summary:**The successful candidate will be responsible for designing, implementing, and maintaining data workflows, ELT processes, and pipelines to move identified data into target platforms for further consumption and...

  • Data Engineer

    1 tydzień temu


    Katowice, Polska SCALO Sp. z o.o. Pełny etat

    W Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...


  • Katowice, Polska SCALO Sp. z o.o. Pełny etat

    W Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...


  • Katowice, Polska RITS Professional Services Pełny etat

    Senior Data Platform EngineerWe are seeking a highly skilled Senior Data Platform Engineer to join our team at RITS Professional Services. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our data platform using cutting-edge technologies such as public cloud infrastructure, Kafka, databases, and...