Data Engineer Python R Prompt Engineering
4 tygodni temu
Job Title: Data Engineer Python R Prompt Engineering
We are seeking a skilled Data Engineer with expertise in Python, R, and Prompt Engineering to join our team. As a Data Engineer, you will be responsible for developing and maintaining automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data sources.
Key Responsibilities:
- Develop and optimize prompt-engineering scripts and semi-automatic flagging/review systems to clean, validate, and standardize metadata for various product fields.
- Create and optimize prompts/scripts to automatically clean, categorize, and tag product metadata.
- Write scripts to handle data cleanup for brands, prices, sizes, and availability.
- Develop systems for manual review of flagged items in the data warehouse (DW).
- Ensure proper merging of products by identifying and consolidating duplicates using UPCs and metadata.
Requirements:
- 3+ years of experience as a Data Engineer or in a similar role.
- Strong proficiency in Python (Mid/Senior level), R (Mid/Senior level), and experience with Java is a plus.
- Experience with NLP techniques, especially in prompt engineering for data automation.
- Proficient in designing and optimizing ETL pipelines and working with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).
- Familiarity with product metadata structures and experience working with large datasets in a commercial environment.
- Excellent problem-solving skills and attention to detail, especially in data validation and error handling.
- Strong communication skills to work effectively with cross-functional teams, including QA, backend developers, and product managers (English and Polish B2 + is a must).
Benefits:
- 25 days of paid leave for B2B or contract services;
- Flexible working hours, with the option to work remotely or from the office;
- Private healthcare (Luxmed);
- Subsidy for insurance (Warta);
- MPCharity: a program where you can propose initiatives that you would like to support.
About Us:
We are a Katowice-based IT company with over 100 people on board—and one dog. We have greatly diversified our operations, and despite the pandemic, we've experienced the most growth in the past few years. Our work focuses on our own product, getzendo.io, collaboration with a client from the United States, and a software house division (providing IT services to external companies).
Recruitment Process:
Step 1: A 45-minute interview with an HR representative (you will receive information about the project, and we will ask a few basic questions);
Step 2: Technical Interview (about 1-1.5h)
Step 3: Final interview with Product Owner (1h)
-
Senior Data Automation Engineer
4 tygodni temu
Jesionowa , Katowice, Polska MPC Pełny etatJob Title: Senior Data Automation EngineerWe are seeking a highly skilled Data Automation Engineer to join our team at MPC. As a key member of our engineering team, you will be responsible for designing and implementing automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data sources.Responsibilities:Develop...
-
NLP Data Automation Specialist
2 tygodni temu
Katowice, Silesia, Polska Massive Pixel Creation Pełny etatProject OverviewWe're developing a mobile app to compare prices across stores in the United States, providing real-time insights for consumers. To enhance quality and automate data processing, we're seeking a talented Data Engineer with expertise in Prompt Engineering.ResponsibilitiesDevelop and maintain prompt-engineering scripts to clean and standardize...
-
Natural Language Processing Data Automation Specialist
3 tygodni temu
Katowice, Silesia, Polska Massive Pixel Creation Pełny etatProject OverviewWe are developing a mobile application that allows users to compare prices of the same products across different stores in the United States. Our goal is to provide consumers with real-time insights into product availability, pricing, and brand choices, helping them make more informed shopping decisions.Key ResponsibilitiesAs a Data Engineer,...
-
NLP Data Automation Specialist
1 miesiąc temu
Katowice, Silesia, Polska Massive Pixel Creation Pełny etatJob Title: NLP Data Automation SpecialistWe are seeking a highly skilled NLP Data Automation Specialist to join our team at Massive Pixel Creation. As a key member of our data engineering team, you will be responsible for developing and maintaining automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data...
-
Senior Data Engineer
4 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleVattenfall is a leading energy company seeking a talented Senior Data Engineer to join our Analytics Hub team. As a key member of our team, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions using Microsoft Azure technology stack.Key Responsibilities:Building and deploying scalable and reliable...
-
Data Infrastructure Engineer
4 tygodni temu
Katowice, Silesia, Polska ING Pełny etatAbout the Role:We are seeking a highly skilled Data Infrastructure Engineer to join our Analytics Engineering team at ING. As a key member of our team, you will be responsible for building and maintaining a platform that supports our data analytics needs.Key Responsibilities:Design and implement a scalable and secure data infrastructureMaintain and improve...
-
Senior Data Engineer
3 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleWe are seeking a skilled Data Engineer to join our Analytics Hub team!Key ResponsibilitiesDesign, develop, and maintain end-to-end analytics solutions using scalable and reliable architectures.Collaborate with the business to identify requirements and deliver tailored solutions.Develop and maintain data pipelines and ETL processes to ingest,...
-
Machine Learning Engineer
4 tygodni temu
Katowice, Silesia, Polska Data Reply Pełny etatJob DescriptionWe are seeking a highly skilled Machine Learning Engineer to join our team at Data Reply. As a key member of our team, you will be responsible for designing, developing, and implementing complex machine learning solutions that drive business value for our clients.Key Responsibilities:Design and develop scalable and efficient machine learning...
-
Senior Data Engineer
4 tygodni temu
Zabrska , Katowice, Polska ING Hubs Poland Pełny etatWe are seeking a skilled Data Engineer to join our team at ING Hubs Poland. As a Data Engineer, you will be responsible for designing and building data pipelines that cater to stakeholder requirements. Your day-to-day activities will involve implementing new features in Kedro/PySpark, testing them in Apache Airflow, and deploying them in our in-house...
-
Senior Data Engineer
3 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions that are scalable, reliable, and efficient.Key ResponsibilitiesDesign and implement data pipelines using various technologies such as...
-
Senior Data Engineer
4 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleVattenfall is seeking a Senior Data Engineer to join our Analytics Hub team. As a key member of our team, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions that meet the needs of our business.Key ResponsibilitiesDesign and develop scalable and reliable data pipelines and ETL processesPerform data...
-
Senior Data Engineer
4 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes that ingest, transform, and...
-
Senior Data Engineer
4 tygodni temu
Katowice, Silesia, Polska Vattenfall Pełny etatAbout the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes that ingest, transform, and...
-
Senior Software Engineer in Python
3 tygodni temu
Katowice, Silesia, Polska SILVERHAND Pełny etatJob Title: Software EngineerJob Summary:We are seeking a skilled Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining our software applications using Python and related technologies.Key Responsibilities:• Develop and implement software applications using Python and...
-
Data Engineering Specialist
14 godzin temu
Katowice, Silesia, Polska ING Pełny etatWe are looking for a highly skilled Data Engineer to join our team at ING. This is an exciting opportunity to grow and develop your career in data engineering.As a Data Engineer, you will be responsible for the development and administration of BI tools, including Power BI and other reporting tools. You will also create business requirements to define...
-
Senior Data Engineer
4 tygodni temu
Katowice, śląskie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you:have hands-on experience building complex data pipelines,have experience with Apache Airflow, Spark, Python,have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),have experience with deployment and provisioning automation tools...
-
Data Workflow Engineer IV
3 dni temu
Katowice, Polska ING Hubs Poland Pełny etatWe are seeking an experienced Data Workflow Engineer IV to join our Financial Markets & Group Treasury team at ING Hubs Poland.**Job Summary:**The successful candidate will be responsible for designing, implementing, and maintaining data workflows, ELT processes, and pipelines to move identified data into target platforms for further consumption and...
-
Data Engineer
1 tydzień temu
Katowice, Polska SCALO Sp. z o.o. Pełny etatW Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...
-
Senior Data Engineer
4 dni temu
Katowice, Polska SCALO Sp. z o.o. Pełny etatW Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...
-
Senior Data Platform Engineer
4 tygodni temu
Katowice, Polska RITS Professional Services Pełny etatSenior Data Platform EngineerWe are seeking a highly skilled Senior Data Platform Engineer to join our team at RITS Professional Services. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our data platform using cutting-edge technologies such as public cloud infrastructure, Kafka, databases, and...