Senior Data Engineer Python Databricks

4 dni temu

Katowice, śląskie, Polska Capco Poland Pełny etat

CAPCO POLAND

*We are looking for Poland based candidate. The job is remote.


Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It’s important to us that we recruit and develop as diverse a range of talent as we can and we believe that everyone brings something different to the table – so we’d love to know what makes you different. Such differences may mean we need to make changes to our process to allow you the best possible platform to succeed, and we are happy to cater to any reasonable adjustments you may require. You will find the section to let us know of these at the bottom of your application form or you can mention it directly to your recruiter at any stage and they will be happy to help.


Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.

We also are experts in CAPCO P O L A N D

* focused on development, automation, innovation, and long-term projects in financial services. In Capco, you can code, write, create, and live at your maximum capabilities without getting dull, tired, or foggy.

THINGS YOU WILL DO

  • Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Databricks.
  • Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics.
  • Lead the migration of data from traditional RDBMS systems to Databricks environments.
  • Architect and design scalable data pipelines and infrastructure to support the organization's data needs.
  • Develop and manage ETL processes using Databricks to ensure efficient data extraction, transformation, and loading.
  • Optimize ETL workflows to enhance performance and maintain data integrity.
  • Ensure seamless data transition with minimal disruption to ongoing operations.
  • Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Databricks environments.
  • Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions.
  • Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them.
  • Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.
  • Provide technical leadership and mentorship to junior members of the data engineering team.
  • Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.
  • Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements.
  • Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies

TECH STACK: Python, Databricks, SQL, AWS/Azure/GCP, Docker, Kubernetes

SKILLS & EXPERIENCES YOU NEED TO GET THE JOB DONE

  • Extensive experience with Databricks, including ETL processes and data migration.
  • Experience with additional cloud platforms like AWS, Azure, or GCP.
  • Knowledge of big data technologies and frameworks.
  • Strong knowledge of data warehousing concepts, data modeling, and SQL
  • Experience with RDBMS systems and transitioning data to modern cloud platforms.
  • Proficiency in programming languages such as Python, SQL, and scripting languages.
  • Knowledge of data governance frameworks, data quality management practices, and data security principles
  • Proficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design.
  • Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Excellent problem-solving and analytical skills. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams
  • Bachelor or Master Degree in Computer Science or related field


NICE TO HAVE

  • Certifications in Databricks


WHY JOIN CAPCO?

  • Employment contract and/or Business to Business - whichever you prefer
  • Possibility to work remotely
  • Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
  • Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
  • Access to 3.000+ Business Courses Platform (Udemy)
  • Access to required IT equipment
  • Paid Referral Program
  • Participation in charity events e.g. Szlachetna Paczka
  • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  • Being part of the core squad focused on the growth of the Polish business unit
  • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
  • A work culture focused on innovation and creating lasting value for our clients and employees

ONLINE RECRUITMENT PROCESS STEPS*

  • Screening call with the Recruiter
  • Technical interview
  • Client Interview
  • Feedback/Offer

  • Senior Data Engineer

    4 tygodni temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience building complex data pipelines,have experience with Apache Airflow, Spark, Python,have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),have experience with deployment and provisioning automation tools...

  • Data Infrastructure Engineer SRE

    4 tygodni temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:are familiar with SRE concepts and System and application monitoring,have knowledge of infrastructure architecture and practices , have good understanding of databases including RDBMS, non-SQL,are experienced with monitoring and observability (ELK stack) ,deployment and provisioning automation tools e.g. Docker, Kubernetes,...

  • Python Developer Mid Senior

    12 godzin temu

    Katowice, śląskie, Polska Etteplan Pełny etat

    Jesteśmy firmą z fińskimi korzeniami, która swoje pierwsze kroki stawiała w usługach inżynieryjnych. Dziś dostarczamy oprogramowanie, współtworzymy nowoczesne rozwiązania dla systemów wbudowanych oraz dokumentację techniczną dla światowych liderów branży przemysłowej, automotive, medycznej czy telekomunikacyjnej.W ramach naszego polskiego...

  • Platform Engineer

    4 tygodni temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience in delivering highly distributed, large scale (data) platforms preferably using open-source technologies,are programming in scripting languages, e.g. Python,are programming in a statically typed language, e.g. JVM (Java/Scala), Golang,have strong experience with SQL/NoSQL datastores (Hive), and other...

  • Senior Embedded Software Engineer

    1 miesiąc temu

    Katowice, śląskie, Polska Antal Sp. z o.o. Pełny etat

    As a Senior Embedded Software Engineer you will join a team that is responsible for new feature development for converters, inverters and independent cart systems. You will take part in design, implementation, and qualification processes of new products, and in feature integration for existing ones. You will also have an opportunity to grow your competencies...

  • Senior DevOps Engineer – Investing

    2 miesięcy temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:3 to 5 years of software support experience, preferably in supporting highly scalable, secure and high-performance applications,good knowledge and understanding of MS Windows and RHEL,experience in at least one programming language like Python, C# or Java,experience operating, monitoring and supporting applications,a good...

  • BI Manager Tech Lead

    3 miesięcy temu

    Katowice, śląskie, Polska KPMG Pełny etat

    Company descriptionZespół Data Intelligence Solutions zajmuje się dostarczaniem naszym Klientom usług z zakresu szeroko pojętej analityki danych, modelowania platform danych i Business Intelligence. Wykorzystujemy nowoczesne technologie Microsoft, jednocześnie stale rozwijamy się i poszukujemy nowych sposobów, by zaspokoić wymagania rynku.Aktualnie...

  • Senior Applied AI Scientist

    3 tygodni temu

    Katowice, śląskie, Polska Relativity Pełny etat

    Are you looking for a hybrid or remote work opportunity? Are you interested in a workplace that allows for flexibility in your day? Are you ready for a workplace that provides benefits that suit your needs?Every year, the global justice system benefits from the insights of Relativity AI on billions of documents– and we are just getting started on our...

  • Senior Consultant

    2 tygodni temu

    Katowice, śląskie, śląskie, Polska KPMG Pełny etat

    Senior Consultant - Financial Services Credit RiskMiejsce pracy: KatowiceTwój zakres obowiązkówwspółtworzenie i walidacja modeli ryzyka kredytowego (scoringi, parametry ryzyka PD/LGD/CCF, modele spełniające wymogi regulacyjne oraz modele zupełnie autorskie, wspierające działania biznesowe)udział w realizacji projektów z zakresu zarządzania...

  • SRE Middleware Engineer

    2 miesięcy temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:Have advanced knowledge of Middleware,Have experience with Linux management,Have the Infrastructure as Code mindset (GitOps, Ansible with Azure DevOps pipeline),Are an individual unafraid of challenges, capable of articulating and justifying their opinion,Have ability to share and support Asset Owners and Engineers with SRE...

  • Oracle Database Developer

    12 godzin temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:around 2-3 years of experience with SQL/RDBMS, specifically Oracle,experience in the design and implementation of data handling processes (ingestion, transformation, modelling, and storage),experience in Python and shell scripting,working knowledge of CI/CD,continuous Improvement mindset - you like to challenge yourself...

  • Devops Expert

    2 miesięcy temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:5+ years of experience,expertise in SQL/RDBMS, specifically Oracle,experience in the design and implementation of data handling processes (ingestion, transformation, modelling, and storage),experience in Python and shell scripting,strong problem-solving and solutions engineering mindset,experience in working and...

  • Secure Development Engineer

    4 miesięcy temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:Are passionate about the field of Cybercrime resilience, secure coding practices, secure design and advanced security testing techniques,Have the hands on experience with testing devices, infrastructure or cloud, networks and applications (including testing web applications and APIs, mobile applications is a plus) and/or...

  • Power BI Expert

    2 tygodni temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:Experience in development and administration of BI systems (3+ years),Experience in shared, multi-technology infrastructure,Strong knowledge of physical database design and data structures,Proficiency in Oracle or MS Sql databases (DQL, DML, DDL, DCL), ETL processes, troubleshooting, optimization performance,Understanding...

  • Site Reliability Engineer SRE

    12 godzin temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have minium 2 years of experience with Oracle database administration,have experience with Operating System Administration be it Windows/Linux,understand and have knowledge for all stack layers – Network, Virtualization, OS,value your time and don’t log in to host to run commands – Infra as a Code is your creed,do not...

  • Senior Controller

    3 tygodni temu

    Katowice, śląskie, śląskie, Polska Advisory Group TEST Human Resources Pełny etat

    Senior Controller - Finance Transformation ProgramMiejsce pracy: KatowiceRecruitment forOur Client operates as an international organization with a worldwide delivery structure providing business services in the areas of Finance, Business Intelligence & Transformation, Human Resources, Procurement and IT. It’s our goal to harmonize and standardize...

  • Senior Transfer Pricing Specialist

    1 miesiąc temu

    Katowice, śląskie, śląskie, Polska Advisory Group TEST Human Resources Pełny etat

    Senior Transfer Pricing SpecialistMiejsce pracy: KatowiceRecruitment forFor our client’s Global Business Service Center in Krakow, we are looking for candidates who are willing to develop their professional career in the area of finance & accounting.Your responsibilitiesUpdate, review, and produce global and local transfer pricing documentation for complex...

  • Senior Credit Risk Model Developer

    1 miesiąc temu

    Katowice, śląskie, śląskie, Polska VeloBank S.A. Pełny etat

    Senior Credit Risk Model Developer Miejsce pracy: KatowiceTechnologie, których używamyWymaganeSQLRPythonTwój zakres obowiązkówbudowa i rozwijanie modeli ryzyka kredytowego (m. in. modele skoringowe, IFRS9, modele windykacyjne),analiza jakości działania modeli, wskazywanie kierunku ich rozwoju i poprawy,analiza danych, wydobywanie z nich wartości...

  • Power BI Specialist

    12 godzin temu

    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:Advance proficiency in Power BI, including DAX and Power Query (2+ years),Advance proficiency in Oracle or MS Sql databases (DQL, DML, DDL, DCL), ETL processes, including tuning and optimization,Strong understanding of data modeling and data visualization best practices,Experience in creating functional, efficient and...

  • Mid Senior React Developer

    4 dni temu

    Katowice, śląskie, Polska Capco Poland Pełny etat

    CAPCO POLAND *We are looking for Poland based candidate. The job is remote but may require some trips to London or Warsaw at the beggining. Warsaw (+nearby) based candidate is preferred.Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality...