Scala/Spark Big Data Developer @ Comscore

2 dni temu

Wrocław, Polska Comscore (via CC) Pełny etat

Correct Context is looking for a  Scala/Spark Big Data Developer  for Comscore in Poland and around. Start of this role is estimated as the beginning of March, but might shift a bit. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors. We offer: Real big data projects - petabyte scale/thousands of servers / billion of events An international team (US/PL/IE/IN/CL/NL) - slack+zoom+english is standard set Hands-on experience - you have the power to execute your ideas and improve stuff Quite a lot of autonomy in how to execute things A small, independent teams' working environment ‍ Flexible work time Fully remote or in-office work in Wroclaw, Poland 14,000 to 20,000 PLN net/month B2B (optional other forms) Private healthcare Multikafeteria / Multisport ️ Free parking If you don't have all the qualifications, but you're interested in what we do and you have a solid Linux understanding -> let's talk The recruitment process for the Scala/Spark Big Data Developer  position has following steps: Technical survey - 10min Technical screening - 30 min Technical task (optional, 1 out of 4 spark teams want to have codility test, async) - ~2h Technical interview - 1h - 2h Interview with Manager - ~30 min The candidate must have: 2+ years of experience with Linux  Solid knowledge of Linux (bash, threads, IPC, filesystems; being power-user is strongly desired, understanding how OS works so you can benefit from performance optimizations in production but also in daily workflows)  1+ years of experience with Spark,  primarily using Scala for Big data processing (that includes understanding of how Spark works and why)  Huge need to drive projects of the future, improve stuff, risk taking mindset - covered by examples  Great communication skills (you can drive end-to-end projects, and guide dev team members)  Professional working proficiency in English (both oral and written)  Understanding of HTTP API communication patterns (HTTP/REST/RPC) and protocol  Good software debugging skills, not only prints, but also using debugger   Deep understanding of at least one technical area (please let us know which one is this and prepare a story of the biggest battle story about this you had)  Quite good understanding of Git  Correct Context is looking for a  Scala/Spark Big Data Developer  for Comscore in Poland and around. Start of this role is estimated as the beginning of March, but might shift a bit. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors. We offer: Real big data projects - petabyte scale/thousands of servers / billion of events An international team (US/PL/IE/IN/CL/NL) - slack+zoom+english is standard set Hands-on experience - you have the power to execute your ideas and improve stuff Quite a lot of autonomy in how to execute things A small, independent teams' working environment ‍ Flexible work time Fully remote or in-office work in Wroclaw, Poland 14,000 to 20,000 PLN net/month B2B (optional other forms) Private healthcare Multikafeteria / Multisport ️ Free parking If you don't have all the qualifications, but you're interested in what we do and you have a solid Linux understanding -> let's talk The recruitment process for the Scala/Spark Big Data Developer  position has following steps: Technical survey - 10min Technical screening - 30 min Technical task (optional, 1 out of 4 spark teams want to have codility test, async) - ~2h Technical interview - 1h - 2h Interview with Manager - ~30 min ,[Design, implement, and maintain petabyte-scale Big data pipelines using Scala, Spark, Kubernetes and a lot of other tech, Optimize – working with Big data is very specific, sometimes it’s IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly , Conduct Proof of Concept (PoC) for enhancements , Writing great and performant Big Data Scala code, Cooperate with other Big data teams , Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark , Use Slack and Zoom for communication ] Requirements: Scala, Spark, Linux, API, AWS Tools: Jira, Bitbucket, GIT, Jenkins. Additionally: Sport Subscription, Private healthcare, Remote work, Flexible working hours, Free coffee, Playroom, Modern office, No dress code, In-house trainings.

  • Scala and Spark Expert Wanted

    24 godzin temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Job DescriptionWe are looking for a Scala and Spark expert to join our team as a Big Data Developer. As a key member of our team, you will be responsible for designing, implementing, and maintaining petabyte-scale Big Data pipelines using Scala, Spark, Kubernetes, and other technologies. You will also work with our international team to optimize and improve...

  • Senior Java/Linux Engineer

    7 dni temu

    Wrocław, Polska Comscore (via CC) Pełny etat

    Correct Context is looking for a experienced Java/Linux Engineer for Comscore in Poland and around. Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...

  • Senior Big Data Engineer

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Comscore, a global leader in media analytics, is seeking a Senior Big Data Engineer to join its team in Poland. The successful candidate will be responsible for migrating 450 bare metal nodes from a datacenter to AWS or another cloud platform.The ideal candidate should have strong experience with Linux, Java, and big data technologies. They should also be...

  • Senior Java/Linux Systems Engineer for Comscore

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    About UsComscore is a global leader in media analytics, empowering businesses across media, advertising, e-commerce, and technology sectors. We're known for our cutting-edge technology and collaboration with industry leaders like Facebook, Disney, and Amazon. Our mission is to deliver accurate data to global businesses and drive innovation in the digital...

  • Cloud Engineer for Big Data Migration

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Company OverviewComscore, a global leader in media analytics, revolutionizes insights into consumer behavior, media consumption, and digital engagement. As a trusted partner delivering accurate data to global businesses, we collaborate with industry leaders like Facebook, Disney, and Amazon.Job DescriptionWe are migrating 450 bare metal nodes from a...

  • Big Data Developer Position

    24 godzin temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Company OverviewComscore (via CC) is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. We thrive on using cutting-edge technology to deliver accurate data to global businesses.

  • Big Data and Linux Migration Specialist

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Are you a talented Big Data and Linux Migration Specialist looking for a new challenge? Comscore, a leading media analytics company, has an exciting opportunity for someone with your skills and experience.We are seeking an expert who can lead the migration of our current infrastructure to a cloud-based platform. This is a unique opportunity to work on a...

  • Petabyte-Scale Data Processing Role

    15 godzin temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Requirements and QualificationsTo succeed in this role, you should have at least 2 years of experience with Linux, solid knowledge of Linux fundamentals, and 1+ year of experience with Spark, primarily using Scala for Big Data processing. Additionally, you should have great communication skills, professional working proficiency in English, and understanding...

  • Big Data Migration Expert Wanted

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Migration ProjectWe're embarking on a complex big data migration project, requiring a skilled Senior Java/Linux Systems Engineer to lead the effort. The project involves migrating 450 bare metal nodes from a datacenter to AWS or another datacenter. Our team is already aware of the technical aspects of this project, so if you're looking for a challenge, we...

  • Linux and Java Architect

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    We are seeking an experienced Linux and Java Architect to join our team at Comscore. As a key member of our engineering team, you will play a crucial role in designing and implementing new architecture solutions for our big data processing systems.Our ideal candidate will have a strong background in Linux, Java, and big data technologies, as well as...

  • Experienced Java Developer

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Role Summary\The Senior Java/Linux Engineer will play a crucial role in our migration project, leading the development of scalable and reliable solutions for Comscore's clients. This challenging position requires a strong background in Linux, Java, and PostgreSQL, as well as excellent communication and problem-solving skills.\\Key Responsibilities\- Design...

  • Data Migration Engineer

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Company OverviewComscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. As a trusted partner delivering accurate data to global businesses, we collaborate with industry leaders like Facebook, Disney, and Amazon.We thrive on using cutting-edge technology, playing a vital role...

  • Big Data Expert

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Netguru Pełny etat

    Transform Your Career with NetguruAt Netguru, we believe that every developer has the potential to grow professionally. As a Senior Data Engineer, you will join a team of experts who value diversity, flexibility, and professionality. Our company culture is designed to support your growth, offering flexible work arrangements, including 100% remote work...

  • Java/Linux Systems Expert

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Job DescriptionWe are migrating 450 bare metal nodes datacenter into AWS or potentially other datacenter. This project involves Linux with diverse ingestion and processing pipelines involving multiple stacks (perl, spark/java, python, postgresql, hbase, hadoop). The target infrastructure is AWS (or other datacenter, depending on service) and Java/Spark.Key...

  • Senior Software Engineer

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    Company Overview\Comscore, a global leader in media analytics, revolutionizes insights into consumer behavior, media consumption, and digital engagement. Our mission is to provide accurate data to businesses worldwide, collaborating with industry leaders like Facebook, Disney, and Amazon.\\Job Description\We are looking for an experienced Java/Linux Engineer...

  • Linux Systems Expert

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Comscore (via CC) Pełny etat

    About the Project\We are embarking on a significant project to migrate our existing infrastructure to AWS or other data centers, utilizing our expertise in Linux, Java, and PostgreSQL. This project presents a unique opportunity for a skilled engineer to contribute to our mission of providing accurate data to businesses worldwide.\\Project Highlights\-...

  • Cloud Data Architect with Expertise in Molecular Biology

    24 godzin temu

    powstańców śląskich, Wrocław, Polska Avenga Pełny etat

    About AvengaAvenga is a leading digital innovation partner that empowers businesses to succeed in a rapidly changing world.Job DescriptionWe are seeking a skilled Senior Data Engineer to join our team and contribute to the design and implementation of cutting-edge cloud data solutions.Key ResponsibilitiesDesign and implement scalable data architectures on MS...

  • Senior Data Architect

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska N-iX Pełny etat

    Required Skills and QualificationsWe are seeking a highly skilled data engineer with advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs. The ideal candidate will have a minimum of 3-4 years of experience as a data engineer or in a relevant field. Additionally, they should be...

  • Molecular Biology Data Expert

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska AVENGA Pełny etat

    We are looking for a talented individual to join our team as a Data Scientist. In this role, you will have the opportunity to work on complex data analysis and modeling tasks, using your skills in machine learning and statistical analysis to drive business insights.Required Skills and QualificationsAzureBig DataETLData ScienceData AnalysisMachine...

  • Cloud Solutions Architect for Big Data Pipelines

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Xebia sp. z o.o. Pełny etat

    At Xebia, we are seeking an experienced Senior AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and deploying scalable data processing pipelines using distributed systems and big data technologies.Key responsibilities include collaborating with analysts and data scientists to...