Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk
Zapisz tę ofertę pracy i uporządkuj wyszukiwanie
Utwórz bezpłatne konto, aby zapisywać oferty pracy, tworzyć alerty i wracać do tego ogłoszenia ze swojego pulpitu nawigacyjnego.
Kontynuując, akceptujesz nasze Warunki & Politykę prywatności.
As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:
Responsibilities
- Develop and maintain data pipelines supporting regulatory reporting for the initiative
- Design and implement distributed data processing solutions using Hadoop and Spark
- Translate complex business requirements into efficient and executable SQL transformations
- Build and maintain SQL‑based data transformations for regulatory data processing
- Manage and monitor workflow orchestration using Oozie and Airflow
- Work with event‑driven architectures, including Kafka
- Provide L3 support for production systems, including incident analysis and resolution
- Collaborate with Production Assurance teams to ensure system stability
- Communicate technical issues and SQL logic clearly to business stakeholders
- Contribute to CI/CD processes, including Git workflows, pull requests, and Jenkins pipelines
- Ensure high data quality, reliability, and compliance with regulatory requirements
Requirements
- Strong experience in data engineering and distributed data processing
- Strong knowledge of SQL‑based data transformation
- Hands‑on experience with Apache Hadoop, Apache Spark, Oozie, Apache Airflow, Kafka / event‑driven architectures and CI/CD tools (Git, PR workflows, Jenkins)
- Ability to translate business requirements into SQL logic
- Experience providing L3 production support
- Ability to collaborate with Production Assurance teams
- Strong analytical and problem‑solving skills
- Strong communication skills, including ability to explain SQL‑related issues to business stakeholders
- Very good command of English, both spoken and written
Nice to Have
- Experience with containerisation and orchestration (Kubernetes)
- Experience with Apache Flink
Offer
- Private medical care
- Co‑financing for the sports card
- Constant support of dedicated consultant
-
Województwo pomorskie, Województwo pomorskie, Polska DCG (Poland) Pełny etat 89 280 zł - 167 400 zł UmowaAs a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking...
-
Senior Data Engineer
1 dzień temu
Województwo pomorskie, Województwo pomorskie, Polska DCG (Poland) Pełny etat 89 280 zł - 167 400 zł UmowaDCG Poland is looking for a skilled data engineer to develop and maintain data pipelines for regulatory reporting. The ideal candidate should possess strong experience in SQL transformations, data engineering, and be proficient in tools such as Apache Hadoop and Spark.You will contribute to system stability and CI/CD processes while collaborating with...
-
Senior Data Engineer
1 dzień temu
Województwo pomorskie, Województwo pomorskie, Polska Diverse CG Sp. z o.o. Sp.k. Pełny etat 50 000 zł - 70 000 zł UmowaDiverse CG Sp. z o.o. Sp.k. is seeking an experienced Data Engineer in Poland to develop and maintain data pipelines supporting regulatory reporting. The candidate will design distributed data processing solutions using technologies like Hadoop and Spark.Applicants should have strong SQL knowledge, experience with workflow orchestration tools, and good...
-
Senior Data Engineer
17 godzin temu
pomorskie, pomorskie, Polska Pełny etatZespół realizujący zaawansowane projekty technologiczne dla Nordea Bank Abp w jednostce Rule Based Monitoring Technology, odpowiedzialnej za rozwój systemów monitorowania transakcji finansowych w obszarze Capital Markets.Budowa wydajnych pipeline'ów danych, rozwój logiki wykrywania nieprawidłowości, frameworków reguł oraz...
-
Województwo pomorskie, Województwo pomorskie, Polska DCG (Poland) Pełny etat 180 000 zł - 240 000 zł UmowaAs a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking...
-
Województwo pomorskie, Województwo pomorskie, Polska Diverse CG Sp. z o.o. Sp.k. Pełny etat 120 000 zł - 180 000 zł UmowaResponsibilities: Develop server-side applications within the Fraud Management domain Collaborate with developers in a Scrum team Contribute to solution design and application maintainability Build and maintain near real-time data pipelines Clarify requirements with Product Owners and stakeholders Collaborate with engineers across teams Document designs and...
-
Województwo pomorskie, Województwo pomorskie, Polska DCG (Poland) Pełny etat 80 000 zł - 120 000 zł UmowaResponsibilitiesDesigning and building a stable, scalable, near real‑time and reliable BMC Helix data replication solutionBuild, design and maintain data architecture ensuring complete collection and quality of data while adhering to best data practicesDesign, build, test and maintain data pipelinesTroubleshooting and innovatingWorking within SAFe Scrum...
-
Województwo pomorskie, Województwo pomorskie, Polska Diverse CG Sp. z o.o. Sp.k. Pełny etat 167 400 zł - 279 000 zł UmowaResponsibilitiesDesigning and building a stable, scalable, near real‑time and reliable BMC Helix data replication solutionBuild, design and maintain data architecture ensuring complete collection and quality of data while adhering to best data practicesDesign, build, test and maintain data pipelinesTroubleshooting and innovatingWorking within SAFe Scrum...
-
Województwo pomorskie, Województwo pomorskie, Polska B2Bnetwork Pełny etat 140 000 zł - 190 000 zł UmowaB2Bnetwork is seeking an experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes in a complex Big Data environment, using Hadoop, Spark, Kafka, Airflow and Jenkins.You will collaborate with stakeholders across...
-
Senior Data Engineer – Scala
2 dni temu
Województwo pomorskie, Województwo pomorskie, Polska B2Bnetwork Pełny etat 140 000 zł - 190 000 zł UmowaWe are looking for an experienced Data Engineer to join an international team working on a strategic regulatory initiative within the financial sector. You will develop and maintain a data platform and reporting processes operating in a complex Big Data environment.ResponsibilitiesDesign, develop and maintain Data Engineering solutions using Hadoop and...