Data Engineer

Data Engineer (with Snowflake/Databricks) Miejsce pracy: Lublin Technologies we use Expected Azure AWS SQL Python About the project Versatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our mission is to ensure capabilities to address financial sector data-related needs. As a Data Engineer, you will be responsible for building and optimizing our clients' data pipelines and data flows. You will work on various data initiatives and ensure optimal data delivery. You are the ideal candidate if you have experience in data warehousing and data wrangling. If you enjoy building data systems from scratch and modifying existing ones, you will have the opportunity to do so at Sollers. Your responsibilities Build scalable data processing pipelines. Identify potential improvements and enhancements for current data processing solutions. Advise on the utilization of appropriate tools and technologies. Research new tools and solutions and advise on their use. Recommend potential enhancements to the existing data architecture. Monitor performance and optimize data processing flows. Collaborate with Business Analysts, Subject Matter Experts, and Tech Leads to ensure thorough consideration of business requirements in both the design and subsequent development phases. Address crucial aspects such as data privacy, security, regulatory compliance, data integrity, and availability. Work directly with our clients as an active member of an agile project team. Our requirements At least 3 years of experience in data engineering. Experience with ETL/ELT processes and building data processing pipelines. Experience working with various data sources (RDBMS, CDC, APIs, data connectors, structured, semi-structured and unstructured files). Experience with various data transformation and processing tools (e.g. Apache Airflow, Apache Nifi, Kafka, Fivetran etc.) Knowledge of data modelling concepts. Proficiency in SQL and good knowledge of at least one programming language (Python, Java, Scala, R). Good command of English language, at least B2/C1 level. Effective communication skills and the ability to work well in a team. Availability to work full time. Ability to work in the European Union. Optional Previous working experience in Insurance industry. Practical experience with Snowflake or Databricks. Practical experience with DWH data modeling. Familiarity with one or more Cloud data stacks (AWS, Azure, GCP). Experience in pipeline orchestration tools (e.g. Airflow). Familiarity with containerization, CI/CD, version control. Fluency in French or German. What we offer Flexible working hours and a hybrid home office model (2-3 times per week in the office) as work-life balance is crucial at Sollers. A chance to be promoted twice a year and a clearly defined career path with salary forecast. Opportunities for growth with a training budget that you can use for courses and conferences. We also provide access to an online training platform and co-fund language classes. An internal coach to guide you through the onboarding, further training and career opportunities, plus a budget to be used for your lunches together. A chance to domore for the planet and the community as part of Sollers Change Makers – our volunteering program. Lots of teambuilding activities, trips, hobby groups and cultural events to create a company powered by teamwork. Probably all the benefits you can think of Benefits private medical care sharing the costs of foreign language classes sharing the costs of professional training & courses life insurance remote work opportunities flexible working time integration events dental care computer available for private use leisure zone redeployment package employee referral program employee assistance program Recruitment stages CV evaluation Test or Phone interview Technical meeting (MS Teams or in our office) Meeting with Hiring Manager (MS Teams or in our office) Sollers Consulting Sollers Consulting is more than a consultancy and software integrator. As a company founded in 2000, our mission has been to transform the financial & insurance industries by helping them adapt to new technologies. The power of collaboration and the limitless potential of Sollers people are at the root of our success. We strive to be the best at what we do, both in the eyes of our team and our customers. We put people at the heart of every project. Join us and make Sollers be driven by... you