Petabyte-Scale Data Processing Role

Job DescriptionWe are looking for a Scala and Spark expert to join our team as a Big Data Developer. As a key member of our team, you will be responsible for designing, implementing, and maintaining petabyte-scale Big Data pipelines using Scala, Spark, Kubernetes, and other technologies. You will also work with our international team to optimize and improve...

About the Role:We are seeking an experienced Scala/Spark Big Data Developer to join our team at Comscore. As a key member of our big data development team, you will design, implement, and maintain large-scale data pipelines using Scala, Spark, and other technologies. You will work closely with our engineering team to develop innovative solutions that drive...

Company Overview:Comscore, a global leader in media analytics, is revolutionizing insights into consumer behavior, media consumption, and digital engagement. We lead in measuring and analyzing audiences across diverse digital platforms.Salary and Benefits:We offer competitive compensation, flexible work time, fully remote or in-office work in Wroclaw,...

About ShelfNo AI strategy without a Data Strategy. Getting GenAI to work is mission-critical for most companies, but 90% of AI projects haven't deployed.Why? Poor data quality - it's the #1 obstacle companies have in getting GenAI projects into production. We've helped some of the best brands like Amazon, Mayo Clinic, AmFam, and Nespresso solve their data...

How You Will Contribute:As a Scala/Spark Big Data Developer at Comscore, you will contribute to the design, implementation, and maintenance of our big data infrastructure. You will work closely with our engineering team to develop innovative solutions that drive business growth and improve customer experiences. Your expertise in Scala, Spark, and other...

Key ResponsibilitiesAs a Backend Engineer at Shelf, your key responsibilities will include:Designing and implementing our distributed ETL pipeline, focusing on background processing logic, data transformation, and scalabilityDeveloping modular and composable components capable of efficiently processing large-scale data across a diverse range of storage...

Work on a large-scale, low-latency trading system processing millions of daily transactions.As a core Java developer for the framework team at Bank of Montreal, you will contribute to systems built primarily in Core Java (17 and 21) with minimal external dependencies.Key Responsibilities Include:Design and implement robust software solutions for the bank's...

About the OpportunityThis is a unique opportunity to build products that have a huge impact on real-world AI applications. As a Senior Python Developer at Shelf, you will work on developing clean, maintainable code in Python, adhering to best practices in observability, cost-efficiency, and robust error handling. You will also contribute to advancing our...

Expertise in Cloud TechnologyAs a data engineer at Xebia, you will be responsible for designing, building, and deploying large-scale infrastructure using distributed systems. You will work on architecture patterns for data processing, workflow definitions, and system-to-system integrations using big data and cloud technologies. Your technical expertise...

SalaryThe base salary for this position ranges from 20,000 - 26,000 PLN net/month. In addition to the competitive salary, we offer a comprehensive benefits package that includes private healthcare, multikafeteria, free parking, and more.Job RequirementsTo succeed in this role, you should have the following skills and qualifications:5+ years of strong Linux...

At Xebia, we are seeking an experienced Senior AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and deploying scalable data processing pipelines using distributed systems and big data technologies.Key responsibilities include collaborating with analysts and data scientists to...

About ShelfShelf is a pioneering company that empowers humanity with better answers everywhere. We provide the core infrastructure that enables General Artificial Intelligence (GenAI) to be deployed at scale. Our mission is to unlock AI readiness and help companies deliver more accurate GenAI answers by eliminating bad data in documents and files.As a...

Work that MattersJoin the Bank of Montreal team and contribute to the development of large-scale trading systems processing millions of transactions daily. As a software engineer, you will work directly with smart, highly capable developers across North America and Europe.In this role, you will design and implement robust software solutions for the bank's...

Requirements and QualificationsTo be successful in this role, you should have extensive experience in data engineering on a terabyte scale, including streaming technologies and near-real-time processing. You should also be proficient in SQL, Python, and cloud platforms like Databricks or Snowflake. Additionally, you should have strong expertise in cloud data...

About the RoleWe are seeking an experienced Data Engineer to join our international team. As a key member of our engineering department, you will play a crucial role in designing, implementing, and maintaining large-scale data systems. Your primary responsibilities will include taking full responsibility for data modeling, ETL processes, and AI development....

About Us: At KUBO, we're committed to delivering cutting-edge security solutions that protect our customers' data. As a key member of our team, you'll play a vital role in shaping our security landscape by developing and implementing log normalization configurations.Your Role: As a Data Transformation Specialist, you'll be responsible for:1. Developing and...

Are you a talented Big Data and Linux Migration Specialist looking for a new challenge? Comscore, a leading media analytics company, has an exciting opportunity for someone with your skills and experience.We are seeking an expert who can lead the migration of our current infrastructure to a cloud-based platform. This is a unique opportunity to work on a...

About UsAt Shelf, we have raised over $60 million in funding and have ambitious hiring goals over the next few months. Our leadership team has deep knowledge management and AI domain expertise and enterprise SaaS background to execute on our company vision. We love our customers, and they truly enjoy working with us because of our innovative capabilities,...

LeverX is looking for a Lead Data Engineer. Don't miss this exciting opportunity to gain experience working with a global IT partner.REQUIREMENTS5+ years of experience working as a Data Engineer:Proficiency in Python and SQL;Extensive experience with AWS products;Knowledge of Data pipeline and workflow management tools like Apache Airflow;Knowledge of...

About Peak DataPeak Data AG is a Swiss-based startup revolutionizing the pharmaceutical industry through innovative data solutions. Our mission is to empower pharmaceutical companies with actionable insights, driving better decision-making and improving patient outcomes.Job OverviewWe are seeking a highly skilled and motivated Data Analyst to join our...