Big Data Engineer Spark Developer

1 miesiąc temu


Kraków, małopolskie, Polska StoneX Poland Pełny etat

Permanent, full-time, hybrid (3 days per week in an office).

Connecting clients to markets – and talent to opportunity.

With 4,300 employees and over 400,000 retail and institutional clients from more than 80 offices spread across five continents, we’re a Fortune-100, Nasdaq-listed provider, connecting clients to the global markets – focusing on innovation, human connection, and providing world-class products and services to all types of investors.

At StoneX, we offer you the opportunity to be part of an institutional-grade financial services network that connects companies, organizations, and investors to the global markets ecosystem. As a team member, you'll benefit from our unique blend of digital platforms, comprehensive clearing and execution services, personalized high-touch support, and deep industry expertise. Elevate your career with us and make a significant impact in the world of global finance.

Business Segment Overview: Empower individual investors – and yourself – in the world of retail through a range of different financial products rooted in innovation and market intelligence. From FX and CFDs to precious metals, master an exciting world of wealth management tools.


Responsibilities


Position Purpose: This role involves designing and developing Databricks applications in pySpark. Our team is rewriting an existing SQL on-prem data warehouse into a Data Lakehouse using Databricks.

Primary duties will include:

  • Migration from on-prem SQL Data Warehouse to Databricks.
  • Developing pySpark applications and Spark jobs.
  • Maintaining Databricks workspaces, clusters, and jobs.
  • Integrating Databricks applications with various technologies.
  • Keep Databricks environment healthy.

Qualifications


To land this role you will need:

  • Must be a Subject Matter Expert in Spark.
  • Proficiency with Big Data processing technologies (Hadoop, Spark, Databricks).
  • Experience in building data pipelines and analysis tools using Python, pySpark, Scala.
  • Create Scala/Spark jobs for data transformation and aggregation.
  • Produce unit tests for Spark transformations and helper methods.
  • Design data processing pipelines.
  • Good to have experience with Hadoop / Databricks.
  • Passionate about learning new technologies.
  • Ability to learn new concepts and software quickly.
  • Analytical approach to problem-solving; ability to use technology to solve business problems.
  • Familiarity with database-centric applications.
  • Ability to communicate effectively in both a technical and non-technical manner.
  • Ability to work in a fast-paced environment.
  • Experience working in an agile environment using SCRUM methodology.
  • Communicate and interact with all levels of personnel within the organization, including senior management, and other departments.
  • Results oriented, team player with strong attention to detail.


What makes you stand out:

  • Relevant experience in the finance services industry, FX, or brokerage experience a plus.
  • Good to have practical and theoretical knowledge of DW concepts (Kimball approach).
  • Good to have Spark certification.


Education / Certification Requirements:

  • Bachelor’s degree or relevant work experience in Computer Science, Mathematics, Data Engineering or related technical discipline.


Working environment:

  • Hybrid (2 days from home, 3 days from the office) at ul. Mogilska 35, Cracow


  • Kraków, małopolskie, Polska Capco Poland Pełny etat

    CAPCO POLAND *We are looking for Poland based candidate. The job is hybrid and requires visits in the office 2 days in a week in Krakow.Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all...

  • Data Engineer

    7 dni temu


    Kraków, małopolskie, Polska INEXTO POLAND Pełny etat

    Are you passionate about cutting-edge technology and innovative solutions? INEXTO, a global leader in Authentication, Secure Serialization, Track & Trace, and Production Volume Verification, is looking for a Data Engineer to join our team. Our technology secures over 100 billion products annually, and we're just getting started!At INEXTO, you'll be...


  • Kraków, małopolskie, Polska Capco Poland Pełny etat

    oining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It’s important to us that we recruit and develop as diverse a range of talent as we can and we believe...

  • Data Engineer ALDI Tech Hub

    1 tydzień temu


    Kraków, małopolskie, Polska ALDI Tech Hub Pełny etat

    Requirements Bachelor or Masters Degree in (business) informatics and relevant job experience Experienced in SQL, Python Experience with the development and operation of cloud technologies (Microsoft Azure, GCP, AWS) Experience with modeling data (Star Schema, Data Vault, Third Normal Form ) and implementation in software products Nice to haves: Azure...

  • AI ML Engineer

    3 miesięcy temu


    Kraków, małopolskie, Polska PAR Data Central Pełny etat

    To deliver solutions that connect people to the restaurants, meals, and moments they love. We take that responsibility very seriously.As a leading restaurant technology provider to the world’s top restaurant brands, we’re calling all rebels, instigators, idealists, and builders to join our constantly growing team. If you’ve excelled at every job,...

  • ML Ops Engineer

    1 miesiąc temu


    Kraków, małopolskie, Polska Capco Poland Pełny etat

    CAPCO POLAND *We are looking for Poland based candidate. The job is remote but may require some business trips.Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to...

  • Data Quality Engineer

    2 miesięcy temu


    Kraków, małopolskie, Polska NeoGames Pełny etat

    /open for all candidates willing to relocate by themselves to Kraków or Warsaw/Data Quality EngineerJoin Aristocrat in Bringing Joy to Life Through the Power of Play. Be part of our growing global team where people come first because they fuel our success. Here, it’s All About the Player and we create a world of its own for everyone, everywhere with...


  • Kraków, małopolskie, Polska InPost Pełny etat

    As a Senior Data Analytics Consultant you will be responsible for analyzing vast volumes of real-time data from diverse systems, including campaigns data, product analytics, user communication and journey, and similar topics relative to InPost Group products. This role spans across Poland and extends to 7 international markets, offering a unique opportunity...


  • Kraków, małopolskie, Polska Hitachi Energy Pełny etat

    Requirements: 10+ years of IT experience within the relevant IT domain Superior analytical skills and a deep understanding of the overall context of business processes and IT technologies Superior experience in leading IT people who do not report directly Superior experience of identifying and resolving issues between team members or other teams...

  • Platform Engineer Airflow

    1 miesiąc temu


    Kraków, małopolskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Platform Engineer...

  • Data Scientist

    5 dni temu


    Kraków, małopolskie, Polska IT-Total Development Pełny etat

    Position Overview IT-Total, is looking for a passionate and experienced Data Scientist that will play also role as Data Engineer. The focus is on delivering data centric solutions with a cloud first mindset.​You will be expected to be the technology wizard and deliver high quality and innovative solutions for our projects and product departments. You will...

  • Data Engineer

    4 tygodni temu


    Kraków, małopolskie, Polska Electrolux Group Pełny etat

    Solve complex problems. Decode the future.We are on an exciting transformational journey of our IT landscape and our ways of working. You will be in the middle of the Operations Data & Analytics Team, dealing with information for our Group Operations Solutions. The larger team is composed of business analysts, data analysts, data engineers and product...


  • Kraków, małopolskie, Polska EPAM Systems Pełny etat

    We are looking for a Senior Data Integration Engineer to join the dynamic Data Practice team and collaborate on EPAM strategic projects.As a Senior Data Integration Engineer, your key role will be to build data systems and applications that drive decision-making. You will primarily focus on developing and maintaining data pipelines and data-driven solutions...


  • Kraków, małopolskie, Polska Amway Pełny etat

    Proficient in data integration, ETL processes, and data pipeline development. Strong knowledge of SQL, relational databases (e.g., Microsoft, Oracle), and cloud data platforms (e.g., Google Cloud, BigQuery). Experience with data processing frameworks (e.g., Hadoop, Spark) and stream processing systems (e.g., Kafka). Demonstrated ability to analyze complex...


  • Kraków, małopolskie, Polska Sigma Software Pełny etat

    We’re seeking a talented Senior Back-End Engineer to play a vital role in building our Customer’s SaaS platform.By joining our team of highly professional and innovative engineers, you’ll have the opportunity to:Make a significant impact on global digital accessibilityWork in an environment driven by engineering excellenceCollaborate with passionate...

  • Shopify Developer

    1 tydzień temu


    Kraków, małopolskie, Polska Strix Pełny etat

    Dream big. Code bigger. Join us!We are looking for a talented and ambitious developer to work in an international environment on innovative, big-scale projects. We offer unlimited opportunities for growth, collaboration with experts from the Netherlands and Germany. Expect a team with great atmosphere, an environment where ideas thrive, and opportunities...


  • Kraków, małopolskie, Polska Hitachi Energy Services Pełny etat

    Develops directly or indirectly the enterprise architect IT policies, standards and guidelines that steer the selection, development, implementation and use of IT application solutions and IT technologies within Hitachi Energy business.Supervises and facilitates the evaluation and selection of appropriate IT applications, IT technologies and IT...

  • Data Analyst

    4 tygodni temu


    Kraków, małopolskie, Polska HSBC Service Delivery Pełny etat

    Some careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.Your career opportunityWe are on a...

  • Backend Developer

    2 miesięcy temu


    Kraków, małopolskie, Polska TechnipFMC Pełny etat

    TechnipFMC is a leading technology provider to the traditional and new energies industry, delivering fully integrated projects, products, and services. With our proprietary technologies and comprehensive solutions, we are transforming our clients’ project economics, helping them unlock new possibilities to develop energy resources while reducing carbon...


  • Kraków, małopolskie, Polska Capco Poland Pełny etat

    CAPCO POLAND *We are looking for Poland based candidate. The job is remote but may require some business trips.Ideal start date: early January 2025Capco is a fully independent, global management and technology consultancy. For 25 years we have combined innovative thinking with deep industry knowledge to deliver business consulting, digital transformation and...