Data Engineer for Scalable Data Infrastructure

5 godzin temu


Plac Solny Wrocław, Polska Shelf Pełny etat

About Shelf

We're revolutionizing the way companies deploy AI strategies by unlocking data quality and readiness. Our innovative approach empowers businesses to deliver accurate GenAI answers by eliminating bad data in documents and files.

As a trusted partner, we've collaborated with leading brands like Amazon, Mayo Clinic, AmFam, and Nespresso to solve their data issues and deploy successful AI initiatives.

We're proud to be partnered with Microsoft, Salesforce, Snowflake, Databricks, OpenAI, and other industry giants who share our vision of bringing GenAI to the enterprise.

Mission:

Our mission is to empower humanity with better answers everywhere.

About the Role:

We're seeking an experienced Data Engineer to join our team and help build robust backend services for large-scale data processing. As a key member of our engineering team, you'll focus on designing, implementing, and optimizing our distributed ETL pipeline.

Your primary responsibilities will include:

  • Distributed ETL Pipeline Design: Develop efficient background processing logic, data transformation, and scalability solutions.
  • Data Storage Solutions: Work with diverse data stores (SQL and NoSQL), including schema design and performance tuning at scale.
  • ML Model Integrations: Collaborate with Data Scientists on model deployment and data flow within the data pipeline.
  • Clean Code Development: Write maintainable code in Python, adhering to best practices in observability, cost-efficiency, and robust error handling.
  • Performance Optimization: Proactively identify and address bottlenecks, proposing solutions to improve scalability and reliability while ensuring continuous production stability.

Requirements:

  • Over 4 years of professional software engineering experience, including more than 1 year specializing in Python.
  • Deep understanding of distributed systems, concurrency patterns, and ETL-oriented workflows.
  • Experience working with diverse data stores (SQL and NoSQL), including schema design and performance tuning at scale.
  • Proven experience building scalable backend applications on either AWS or Azure, including a strong understanding of their respective services for compute, storage, and data processing.
  • Ability to write well-structured, testable code with thoughtful abstractions and interfaces.
  • Strong problem-solving skills, including troubleshooting performance bottlenecks and legacy code.
  • Upper-Intermediate or better English skills for technical communication and documentation.

What We Offer:

  • B2B contract.
  • Company Stock Options.
  • Hardware: MacBook Pro.
  • Modern technical stack. Develop open-source software.
  • GitHub Copilot subscription.
  • LLM credits for other OSS AI code assistants and internal AI tools.

Why Join Us:

  • Our Leadership Team has deep knowledge management and AI domain expertise and enterprise SaaS background to execute on the company vision.
  • We have high velocity growth powered by the most innovative product in our category, 3X growth for 3 years in a row.
  • We now have over 100 employees in multiple U.S. states and European countries, and we have ambitious hiring goals over the next few months.


  • Wrocław, Polska Xebia Pełny etat

    Job DescriptionAbout the Role:We are seeking a skilled Data Engineer to join our team at Xebia. The successful candidate will be responsible for designing, building, and maintaining scalable data processing systems using cloud technologies.Key Responsibilities:Data Processing and Architecture: Design and implement efficient data processing pipelines using...

  • Lead Data Engineer

    16 godzin temu


    Wrocław, dolnośląskie, Polska LeverX Pełny etat

    LeverX is looking for a Lead Data Engineer. Don't miss this exciting opportunity to gain experience working with a global IT partner.REQUIREMENTS5+ years of experience working as a Data Engineer:Proficiency in Python and SQL;Extensive experience with AWS products;Knowledge of Data pipeline and workflow management tools like Apache Airflow;Knowledge of...

  • Senior Big Data Engineer

    18 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Comscore, a global leader in media analytics, is seeking a Senior Big Data Engineer to join its team in Poland. The successful candidate will be responsible for migrating 450 bare metal nodes from a datacenter to AWS or another cloud platform.The ideal candidate should have strong experience with Linux, Java, and big data technologies. They should also be...


  • Wrocław, dolnośląskie, Polska Lingaro Pełny etat

    We are seeking an experienced Cloud Data Engineer proficient with SQL, Azure cloud stack and Databricks. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks:Designing and implementing data processing systems on Azure platform. This involves writing efficient and...


  • Wrocław, dolnośląskie, Polska Experis Manpower Group Pełny etat

    Your future tasks:Develop and deploy Cloud solutions for handling large and unstructured data setsFine-tune and validate Data Warehouse/ Big Data solutions within a Continuous Integration/ Continuous Delivery frameworkOversee the smooth transition of data infrastructure from on-premises environments to public Cloud platformsCreate Data, AI, and ML...


  • Wrocław, Województwo dolnośląskie, Polska Aristocrat Interactive Pełny etat

    Aristocrat Interactive is a leader in the online Real Money Gaming industry, driving innovation through technology and creativity.Our mission is to bring joy to life through the power of play, across a range of digital entertainment channels. We are seeking an experienced Data Quality Automation Expert to join our growing global team.About the Role:The Data...


  • Marszałka Józefa Piłsudskiego , Wrocław, Polska LeverX Pełny etat

    Company Overview: LeverX is a global IT partner that empowers businesses through innovative solutions.Job Description: We are seeking an experienced Lead Data Engineer to join our team and contribute to the development of our data infrastructure and pipelines.Responsibilities:Architect and develop data infrastructure and pipelines;Establish best practices,...


  • Wrocław, Polska Dev.Pro Pełny etat

    🟢 Join Dev.Pro - a US-based outsourcing software development company that has been delivering exceptional software experience to clients since 2011. We invite a talented, organized, and reliable Data Engineer to join our team and play an important role in building a project that connects the art market with the digital-first financial ecosystem. Work...

  • Senior Data Analyst

    1 dzień temu


    Wrocław, Polska Jobs for Humanity Pełny etat

    Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Travel Percentage : 1 - 5% Are you curious, motivated, and forward-thinking? At FIS you will have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in...

  • Data Analytics Specialist

    18 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Jobs for Humanity Pełny etat

    Company OverviewFIS Global is a leading provider of financial services and technology solutions. Our team works on some of the most challenging and relevant issues in the industry, empowering us to deliver exceptional results.Job DescriptionAs a Derivatives Operations Expert, you will play a critical role in our Global Operations team, providing...


  • Wrocław, Województwo dolnośląskie, Polska Dev Pełny etat

    About the RoleThis is an exciting opportunity for a talented Data Engineer to join our team and contribute to innovative projects at the crossroads of the blockchain and art industries. You will work with a small, dynamic team to meet project milestones, focusing on scalability and reliability.ResponsibilitiesOversee the data warehouse and pipeline, from...

  • Senior Data Engineer

    18 godzin temu


    Wrocław, Województwo dolnośląskie, Polska Netguru Pełny etat

    Netguru: A Partner for Your Professional GrowthAt Netguru, we strive to be a trusted partner for innovators and entrepreneurs. Our mission is to help shape the world through beautiful software.As a Senior Data Engineer, you will play a key role in our team, working on projects that impact various industries such as fintech, healthcare, insurance, or...


  • Wrocław, Polska SwingDev Pełny etat

    At SwingDev, we're revolutionizing home insurance with our cutting-edge technology and innovative approach. Our mission is to deliver intuitive and proactive protection for homeowners, combining the power of technology with a human touch.About the CompanyWe're a Polish branch of a fast-growing InsurTech product company from Silicon Valley - Hippo Insurance....


  • Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Company OverviewComscore, a global leader in media analytics, revolutionizes insights into consumer behavior, media consumption, and digital engagement. As a trusted partner delivering accurate data to global businesses, we collaborate with industry leaders like Facebook, Disney, and Amazon.Job DescriptionWe are migrating 450 bare metal nodes from a...


  • plac Europejski , Warszawa, Polska Samsung R&D Institute Poland Pełny etat

    About our TeamWe are seeking a highly skilled Big Data Engineer to contribute to the development and growth of Samsung's DSP platform.The ideal candidate will work closely with local teams in Warsaw, as well as collaborate with remote teams across the globe (US, Korea, India, UK) to implement and deploy innovative services.Expertise in data engineering will...


  • Wrocław, dolnośląskie, Polska Michael Page International Sp. z o.o. Pełny etat

    About Our ClientOur Client is a global leader in consulting, technology services, and digital transformation. The company delivers a wide range of technology solutions, including software development, system integration, application management, and cloud services. They partner with top technology providers like Microsoft, SAP, Oracle, and Google.Job...

  • Data Engineer

    1 dzień temu


    Wrocław, dolnośląskie, Polska PSE Innowacje sp. z o.o. Pełny etat

    PSE Innowacje sp. z o.o. poszukuje kandydatów na stanowisko:Data engineerPodstawowy zakres obowiązków na stanowisku:Projektowanie i budowanie architektury danychIntegracja danych z różnych źródełAutomatyzacja procesów ETLWsparcie dla zespołów analitycznych i data scientistsZapewnienie jakości dla dostarczanego kodu, wsparcie w analizie,...


  • Wrocław, Polska Idego Group Sp. z o.o. Pełny etat

    For our client in the public sector in Finland, we are seeking an experienced  Data Engineer with a strong background in data warehousing, analytics technologies, and client collaboration. Minimum of 3 years of experience working with clients. Proven knowledge of technologies/tools related to data warehousing (e.g., Snowflake, BigQuery, Apache Spark, DBT )...

  • Data Engineer

    18 godzin temu


    Wrocław, Województwo dolnośląskie, Polska SoftKraft Pełny etat

    Company OverviewSoftKraft is a technology company created by programmers for programmers. Our values are Ownership, Excitement, Learning, Communication, and Teamwork. We exist to delight our customers and coworkers by providing a challenging environment for personal and professional growth.Job DescriptionAs a Financial Data Engineer at SoftKraft, you will be...

  • Data Engineer

    5 dni temu


    Wrocław, dolnośląskie, Polska Transition Technologies MS Pełny etat

    We offer:Participation in interesting and challenging projectsFlexible working hoursA great, non-corporate atmosphereStable employment conditions (contract of employment or B2B contract)Opportunities for development and promotionAttractive package of benefitsRemote workYour tasks:The responsibilities of this person will include development of components...