Lead MLOPs Engineer

Technology stack

• GCP (must have) , BigQuery, Cloud Storage, Apache Airflow, Cloud Composer,

· Vertex AI, Dataproc, Compute Engine

• CI/CD and Build tooling: Terraform, Terragrunt, Jenkins, Groovy, Crane, Kaniko

• Python, PySpark, Docker, Jupyter, Apache Airflow, Spark, Java (optional, but would

· be beneficial)

Key Responsibilities

• Establish and maintain best practices for ML Ops. Including version control, CI/CD

• pipelines and the Vertex Al Model Registry and End Points.

• Implement MLOps tools to streamline model development, training, tuning,

• deployment, monitoring and explain.

• Deploy and Manage ML models on GCP's Vertex Al platform ensuring efficient and

• scalable execution.

• Identify and address performance bottleneck in ML models and pipelines.

• Troubleshoot and resolve ML issues ensuring optimal model performance and

• costs. Work Closely with Compliance Analytics data scientists to prepare and

• preprocess data for model training and evaluation.

• Assist in feature engineering and selection to ensure model performance

• Develop techniques to visualize and explain model behavior ensuring model transparency and accountability in-line with PRA S51/23 guidelines.

• Collaborate with infrastructure and DevOps teams to establish efficient deployment and scaling strategies.

Pipeline Development:

• Build and maintain robust pipelines for model training, tuning and deployment leveraging components of Vertex Al and GCP tooling like Cloud Composer utilizing Python and Java and Big Query.

• Implement automated monitoring and alerting to track model performance and identify potential issues.

• Develop and maintain data quality checks and validation including reconciliations in-line with Data Quality and Retention Controls.

• Implement robust security measures to protect sensitive data and models.

Required Skills and Experience:

• Strong proficiency in ML Ops principles and tools.

• Proficiency in data engineering and pipeline development.

• Experience with GCP including Big Query, Cloud Composer and Vertex Al.

• Strong problem-solving and analytical skills.

• Strong proficiency in Python

• Experience with Java would be beneficial.