Model Oversight team

The second line of defence Model Oversight team provides support to our colleagues in Borrowing, Fincrime & Fraud, Finance and Operations to help Monzo grow safely. We’re looking for a Model Validation Senior Manager - Gen AI to lead the teams’ oversight of Generative AI models/use cases.

You’ll play a key role by...

Driving the embedding of the Model Risk Framework for Generative AI use cases across Monzo

• Lead the collaboration with the first line of defence teams to strengthen policies, standards and procedures for Generative AI model, use case, system design and build, implementation, governance, monitoring and use.
• Own the setting and maintenance of Generative AI validation methods, evidence expectations and reusable technical assets.
• Convert modelling/validation experience into controlled playbooks, tests and working examples.
• Coach Generative AI validation methodologies to 2LoD Model Oversight colleagues.

Leading the 2LoD Oversight of Operational Model Risk

• Perform and oversee independent model validations of new Operational models (primarily Generative AI models, use cases, systems).
• Build relationships with first line of defence modelling teams.
• Review ongoing model performance monitoring.
• Monitor and measure the overall level of Operational model risk.

Being a senior advocate of Model Risk Management best practices

• Support the effective operation of the Model Risk Oversight Committee.
• Promote and help embed a strong risk culture.

We’d love to hear from you if…

• You are highly motivated and energised by the idea of bringing positive impact to our customers and Monzo.
• You are self-motivated and thrive in a fast-paced environment.
• You have great attention to detail while keeping an eye on the big picture.
• You are a great communicator, able to articulate complex problems.
• You can provide effective challenge whilst building strong, respectful relationships.
• You are keen to grow your knowledge in both business and technology.

Technical and knowledge requirements

• Robust Data Science or Machine Learning background with strong Python capability.
• Experience with design of Generative AI evaluation frameworks, architectures, methods, practical tooling and platform alignment.
• Knowledge of Gemini implementations and change assessment.
• Experience of managing a modelling project through its full lifecycle.