Data Engineering and ML Operations Specialist

At Antal Sp. z o.o., we're seeking a highly skilled Data Engineering and ML Operations Specialist to join our team.

About the Role:

We're looking for a talented individual with expertise in data engineering, machine learning operations (ML Ops), and cloud computing. As a Data Engineering and ML Operations Specialist, you'll be responsible for designing, building, and maintaining large-scale data pipelines and machine learning models on Google Cloud Platform (GCP).

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using GCP services such as BigQuery, Cloud Composer, and Vertex AI.
• Collaborate with data scientists to preprocess data, prepare datasets, and optimize model performance.
• Develop and maintain robust CI/CD pipelines using Terraform, Terragrunt, Jenkins, Groovy, Crane, and Kaniko.
• Implement automated monitoring and alerting systems to track model performance and identify potential issues.
• Work closely with infrastructure and DevOps teams to establish efficient deployment and scaling strategies.
• Build and maintain robust security measures to protect sensitive data and models.
• Develop techniques to visualize and explain model behavior ensuring model transparency and accountability.

Required Skills and Experience:

• Strong proficiency in data engineering principles, ML Ops tools, and cloud computing platforms.
• Proficiency in Python programming language and experience with Java would be beneficial.
• Experience with GCP services such as Big Query, Cloud Composer, and Vertex AI.
• Strong problem-solving and analytical skills.

Benefits:

We offer a competitive compensation package, comprehensive benefits, and opportunities for professional growth and development.