PySpark Big Data Developer

1 tydzień temu

Wrocław, Województwo dolnośląskie, Polska Correct Context Pełny etat 12 000 zł - 18 000 zł

Correct Context is looking for a PySpark Big Data Developer for Comscore in Poland and around.Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.We offer:Real big data projects (PB scale) An international team (US, PL, IE, CL) A small, independent team working environment High influence on working environmentHands on environmentFlexible work time Fully remote or in-office work in Wroclaw, Poland 12, ,000 PLN net/month B2B Private healthcare (PL) Multikafeteria (PL) Free parking (PL)As a Big Data Developer, you'll:Design, implement and maintain petabyte-scale Big data pipelines using Python, PySpark, Apache Airflow, Kubernetes and a lot of other techOptimize – working with Big data is very specific, sometimes it's IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costlyCooperate with other Big data teamsWork with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and SparkThe candidate must have:Solid understanding of Spark basics, building blocks and mechanicsSolid understanding of python (especially PySpark)1+ years of experience with Spark, primarily using Python (PySpark) or Scala for Big Data processing (that includes understanding of how Spark works and why)1+ years of experience with Linux, if you are poweruser - it's betterGreat communication skills (you can drive end-to-end projects, and guide dev team members)Professional working proficiency in English (both oral and written)Understanding of HTTP API communication patterns (HTTP/REST/RPC) and protocolGood software debugging skills, not only prints, but also using debuggerDeep understanding of at least one technical area (please let us know which one is this and prepare a story of the biggest battle story about this you had)Quite good understanding of GitIf you don't have all the qualifications, but you're interested in what we do and you have a solid Linux understanding -> let's talkThe recruitment process for the PySpark Big Data Developer position has following steps:Technical survey - 10minTechnical screening - 30 min video callTechnical interview - 60min video callFinal Interview - Technical/Managerial - 30 min video call

  • Python Big Data Developer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Correct Context Pełny etat 120 000 zł - 180 000 zł rocznie

    Correct Context is looking for a  Python Big Data Developer for Comscore in Poland and around.Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology,...

  • Scala/Spark Big Data Developer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Correct Context Pełny etat 18 000 zł - 25 000 zł

    Correct Context is looking for a Scala/Spark Big Data Developer for Comscore in Poland and around.Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge...

  • Python/Django Big Data Developer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Correct Context Pełny etat 8 000 zł - 13 000 zł

    Correct Context is looking for a Python/Django FullStack Developer for Comscore in Poland and around.We are looking for Python Developer acting as Fullstack (we are more interested in Python/Django than React frontend) to help building API data layers using Django/DRF and potentially doing some frontend work as needed.Comscore is a global leader in media...

  • Data Engineer

    2 tygodni temu

    Wrocław, dolnośląskie, dolnośląskie, Polska Insert S.A. Pełny etat

    Data Engineer (Microsoft Fabric i PySpark)Miejsce pracy: WrocławTechnologie, których używamyWymaganeMicrosoft FabricPySparkSQLPythonAzure Data FactoryMile widzianeMicrosoft Power BISystem operacyjnyWindowsO projekcieNasz dział oprogramowania nieustannie pracuje nad doskonaleniem produktów, aby spełniać oczekiwania rynku. Do jednego z naszych...

  • Big Data Engineer

    6 dni temu

    Wrocław, Województwo dolnośląskie, Polska Grid Dynamics Pełny etat

    We're seeking a highly skilled Big Data Engineer to design and build critical financial technology solutions. This role is central to developing a tool that empowers financial advisors to manage client opportunities based on defined business rules.ResponsibilitiesDesign, develop, and deploy Spark-based solutions for cleaning, transforming, and analyzing vast...

  • Senior Big Data Engineer GraphDB

    4 tygodni temu

    Wrocław, dolnośląskie, Polska SoftServe Pełny etat

    WE ARESoftServe is a global digital solutions company headquartered in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.Big Data & Analytics is the data consulting and engineering arm of...

  • Azure Senior Developer

    1 tydzień temu

    Wrocław, Województwo dolnośląskie, Polska Luxoft Pełny etat 80 000 zł - 120 000 zł rocznie

    Project descriptionLuxoft has one of the world's leading Orchestrade practices. We are a top-tier Orchestrade Partner and a market leader in implementation, integration, upgrade, and migration.We provide end-to-end project services and have delivered Orchestrade projects across all major asset classes and sectors including investment banking, asset...

  • Junior Linux Engineer in Big Data Validation

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Correct Context Pełny etat 6 000 zł - 9 000 zł

    Correct Context is looking for a Junior Linux Engineer in Big Data Validation for Comscore in Poland and around.Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using...

  • Data Engineer

    4 dni temu

    Wrocław, Województwo dolnośląskie, Polska Schaeffler Pełny etat 80 000 € - 120 000 € rocznie

    Schaeffler is a dynamic global technology company and its success has been a result of its entrepreneurial spirit and long history of private ownership. Does that sound interesting to you? As a partner to all of the major automobile manufacturers, as well as key players in the aerospace and industrial sectors, we offer you many development opportunities.Your...

  • Senior Big Data Engineer AWS

    4 tygodni temu

    Wrocław, dolnośląskie, Polska SoftServe Pełny etat

    WE ARESoftServe is a global digital solutions company headquartered in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.Big Data & Analytics is the Center of Excellence's data consulting...