Data Engineer for Scalable Data Infrastructure
5 godzin temu
About Shelf
We're revolutionizing the way companies deploy AI strategies by unlocking data quality and readiness. Our innovative approach empowers businesses to deliver accurate GenAI answers by eliminating bad data in documents and files.
As a trusted partner, we've collaborated with leading brands like Amazon, Mayo Clinic, AmFam, and Nespresso to solve their data issues and deploy successful AI initiatives.
We're proud to be partnered with Microsoft, Salesforce, Snowflake, Databricks, OpenAI, and other industry giants who share our vision of bringing GenAI to the enterprise.
Mission:
Our mission is to empower humanity with better answers everywhere.
About the Role:
We're seeking an experienced Data Engineer to join our team and help build robust backend services for large-scale data processing. As a key member of our engineering team, you'll focus on designing, implementing, and optimizing our distributed ETL pipeline.
Your primary responsibilities will include:
- Distributed ETL Pipeline Design: Develop efficient background processing logic, data transformation, and scalability solutions.
- Data Storage Solutions: Work with diverse data stores (SQL and NoSQL), including schema design and performance tuning at scale.
- ML Model Integrations: Collaborate with Data Scientists on model deployment and data flow within the data pipeline.
- Clean Code Development: Write maintainable code in Python, adhering to best practices in observability, cost-efficiency, and robust error handling.
- Performance Optimization: Proactively identify and address bottlenecks, proposing solutions to improve scalability and reliability while ensuring continuous production stability.
Requirements:
- Over 4 years of professional software engineering experience, including more than 1 year specializing in Python.
- Deep understanding of distributed systems, concurrency patterns, and ETL-oriented workflows.
- Experience working with diverse data stores (SQL and NoSQL), including schema design and performance tuning at scale.
- Proven experience building scalable backend applications on either AWS or Azure, including a strong understanding of their respective services for compute, storage, and data processing.
- Ability to write well-structured, testable code with thoughtful abstractions and interfaces.
- Strong problem-solving skills, including troubleshooting performance bottlenecks and legacy code.
- Upper-Intermediate or better English skills for technical communication and documentation.
What We Offer:
- B2B contract.
- Company Stock Options.
- Hardware: MacBook Pro.
- Modern technical stack. Develop open-source software.
- GitHub Copilot subscription.
- LLM credits for other OSS AI code assistants and internal AI tools.
Why Join Us:
- Our Leadership Team has deep knowledge management and AI domain expertise and enterprise SaaS background to execute on the company vision.
- We have high velocity growth powered by the most innovative product in our category, 3X growth for 3 years in a row.
- We now have over 100 employees in multiple U.S. states and European countries, and we have ambitious hiring goals over the next few months.
-
Wrocław, Polska Xebia Pełny etatJob DescriptionAbout the Role:We are seeking a skilled Data Engineer to join our team at Xebia. The successful candidate will be responsible for designing, building, and maintaining scalable data processing systems using cloud technologies.Key Responsibilities:Data Processing and Architecture: Design and implement efficient data processing pipelines using...
-
Lead Data Engineer
16 godzin temu
Wrocław, dolnośląskie, Polska LeverX Pełny etatLeverX is looking for a Lead Data Engineer. Don't miss this exciting opportunity to gain experience working with a global IT partner.REQUIREMENTS5+ years of experience working as a Data Engineer:Proficiency in Python and SQL;Extensive experience with AWS products;Knowledge of Data pipeline and workflow management tools like Apache Airflow;Knowledge of...
-
Senior Big Data Engineer
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etatComscore, a global leader in media analytics, is seeking a Senior Big Data Engineer to join its team in Poland. The successful candidate will be responsible for migrating 450 bare metal nodes from a datacenter to AWS or another cloud platform.The ideal candidate should have strong experience with Linux, Java, and big data technologies. They should also be...
-
Senior Azure Data Engineer
1 dzień temu
Wrocław, dolnośląskie, Polska Lingaro Pełny etatWe are seeking an experienced Cloud Data Engineer proficient with SQL, Azure cloud stack and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks:Designing and implementing data processing systems on Azure platform. This involves writing efficient and...
-
Data Platform Engineer
6 dni temu
Wrocław, dolnośląskie, Polska Experis Manpower Group Pełny etatYour future tasks:Develop and deploy Cloud solutions for handling large and unstructured data setsFine-tune and validate Data Warehouse/ Big Data solutions within a Continuous Integration/ Continuous Delivery frameworkOversee the smooth transition of data infrastructure from on-premises environments to public Cloud platformsCreate Data, AI, and ML...
-
Data Quality Automation Expert
4 dni temu
Wrocław, Województwo dolnośląskie, Polska Aristocrat Interactive Pełny etatAristocrat Interactive is a leader in the online Real Money Gaming industry, driving innovation through technology and creativity.Our mission is to bring joy to life through the power of play, across a range of digital entertainment channels. We are seeking an experienced Data Quality Automation Expert to join our growing global team.About the Role:The Data...
-
Lead Data Engineer: Strategic Pipeline Architect
5 godzin temu
Marszałka Józefa Piłsudskiego , Wrocław, Polska LeverX Pełny etatCompany Overview: LeverX is a global IT partner that empowers businesses through innovative solutions.Job Description: We are seeking an experienced Lead Data Engineer to join our team and contribute to the development of our data infrastructure and pipelines.Responsibilities:Architect and develop data infrastructure and pipelines;Establish best practices,...
-
Intermediate Data Engineer
1 dzień temu
Wrocław, Polska Dev.Pro Pełny etat🟢 Join Dev.Pro - a US-based outsourcing software development company that has been delivering exceptional software experience to clients since 2011. We invite a talented, organized, and reliable Data Engineer to join our team and play an important role in building a project that connects the art market with the digital-first financial ecosystem. Work...
-
Senior Data Analyst
1 dzień temu
Wrocław, Polska Jobs for Humanity Pełny etatPosition Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Travel Percentage : 1 - 5% Are you curious, motivated, and forward-thinking? At FIS you will have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in...
-
Data Analytics Specialist
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska Jobs for Humanity Pełny etatCompany OverviewFIS Global is a leading provider of financial services and technology solutions. Our team works on some of the most challenging and relevant issues in the industry, empowering us to deliver exceptional results.Job DescriptionAs a Derivatives Operations Expert, you will play a critical role in our Global Operations team, providing...
-
Data Engineer for Art and Blockchain Project
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska Dev Pełny etatAbout the RoleThis is an exciting opportunity for a talented Data Engineer to join our team and contribute to innovative projects at the crossroads of the blockchain and art industries. You will work with a small, dynamic team to meet project milestones, focusing on scalability and reliability.ResponsibilitiesOversee the data warehouse and pipeline, from...
-
Senior Data Engineer
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska Netguru Pełny etatNetguru: A Partner for Your Professional GrowthAt Netguru, we strive to be a trusted partner for innovators and entrepreneurs. Our mission is to help shape the world through beautiful software.As a Senior Data Engineer, you will play a key role in our team, working on projects that impact various industries such as fintech, healthcare, insurance, or...
-
Wrocław, Polska SwingDev Pełny etatAt SwingDev, we're revolutionizing home insurance with our cutting-edge technology and innovative approach. Our mission is to deliver intuitive and proactive protection for homeowners, combining the power of technology with a human touch.About the CompanyWe're a Polish branch of a fast-growing InsurTech product company from Silicon Valley - Hippo Insurance....
-
Cloud Engineer for Big Data Migration
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etatCompany OverviewComscore, a global leader in media analytics, revolutionizes insights into consumer behavior, media consumption, and digital engagement. As a trusted partner delivering accurate data to global businesses, we collaborate with industry leaders like Facebook, Disney, and Amazon.Job DescriptionWe are migrating 450 bare metal nodes from a...
-
plac Europejski , Warszawa, Polska Samsung R&D Institute Poland Pełny etatAbout our TeamWe are seeking a highly skilled Big Data Engineer to contribute to the development and growth of Samsung's DSP platform.The ideal candidate will work closely with local teams in Warsaw, as well as collaborate with remote teams across the globe (US, Korea, India, UK) to implement and deploy innovative services.Expertise in data engineering will...
-
Cloud Data Engineer Snowflake
1 dzień temu
Wrocław, dolnośląskie, Polska Michael Page International Sp. z o.o. Pełny etatAbout Our ClientOur Client is a global leader in consulting, technology services, and digital transformation. The company delivers a wide range of technology solutions, including software development, system integration, application management, and cloud services. They partner with top technology providers like Microsoft, SAP, Oracle, and Google.Job...
-
Data Engineer
1 dzień temu
Wrocław, dolnośląskie, Polska PSE Innowacje sp. z o.o. Pełny etatPSE Innowacje sp. z o.o. poszukuje kandydatów na stanowisko:Data engineerPodstawowy zakres obowiązków na stanowisku:Projektowanie i budowanie architektury danychIntegracja danych z różnych źródełAutomatyzacja procesów ETLWsparcie dla zespołów analitycznych i data scientistsZapewnienie jakości dla dostarczanego kodu, wsparcie w analizie,...
-
Data Engineer @ Idego Group Sp. z o.o.
1 dzień temu
Wrocław, Polska Idego Group Sp. z o.o. Pełny etatFor our client in the public sector in Finland, we are seeking an experienced Data Engineer with a strong background in data warehousing, analytics technologies, and client collaboration. Minimum of 3 years of experience working with clients. Proven knowledge of technologies/tools related to data warehousing (e.g., Snowflake, BigQuery, Apache Spark, DBT )...
-
Data Engineer
18 godzin temu
Wrocław, Województwo dolnośląskie, Polska SoftKraft Pełny etatCompany OverviewSoftKraft is a technology company created by programmers for programmers. Our values are Ownership, Excitement, Learning, Communication, and Teamwork. We exist to delight our customers and coworkers by providing a challenging environment for personal and professional growth.Job DescriptionAs a Financial Data Engineer at SoftKraft, you will be...
-
Data Engineer
5 dni temu
Wrocław, dolnośląskie, Polska Transition Technologies MS Pełny etatWe offer:Participation in interesting and challenging projectsFlexible working hoursA great, non-corporate atmosphereStable employment conditions (contract of employment or B2B contract)Opportunities for development and promotionAttractive package of benefitsRemote workYour tasks:The responsibilities of this person will include development of components...