What is ModelOps and MLOps?

“ModelOps lies at the center of any organizations’ enterprise AI strategy.”
Gartner, Innovation Insight for ModelOps, August 2020 Farhan Choudhary, Shubhangi Vashisth, Arun Chandrasekaran, Erick Brethenoux
What is ModelOps and MLOps?
“ModelOps lies at the center of any organizations’ enterprise AI strategy.”
Gartner, Innovation Insight for ModelOps, August 2020 Farhan Choudhary, Shubhangi Vashisth, Arun Chandrasekaran, Erick Brethenoux
ModelOps Document Icon
Report:
State of ModelOps 2021
ModelOps Video Icon
Free Gartner Webinar:
Use ModelOps for an Effective AI Strategy
ModelOps Video Icon
Video:
ModelOps Overview
(1:40)
ModelOps and MLOps
“AI model operationalization (ModelOps) is primarily focused on the governance and life cycle management of all AI and decision models (including models based on machine learning, knowledge graphs, rules, optimization, linguistics and agents). In contrast to MLOps, which focuses only on the operationalization of ML models, and AIOps which is AI for IT Operations, ModelOps focuses on the operationalization of all AI and decision models.”
Gartner, Innovation Insight for ModelOps, August 2020
Farhan Choudhary, Shubhangi Vashisth, Arun Chandrasekaran, Erick Brethenoux
ModelOps includes MLOps
“ModelOps refers to the operationalization of all AI models and includes MLOps that deals with the operationalization of ML models”
Gartner, “Use Gartner’s 3-Stage MLOps Framework to Successfully Operationalize Machine Learning Projects”, July 2, 2020, Shubhangi Vashisth, Erick Brethenoux, Farhan Choudhary, Jim Hare
Resources
Webinars
Gartner Webinar
Use ModelOps for an Effective AI Strategy
A panel of Gartner analysts share how ModelOps makes enterprise AI initiatives more efficient and effective through governance, automation and orchestration.
Operationalize AI Initiatives
Stu Bailey, ModelOp Chief Enterprise AI Architect and Co-Founder shares the role of ModelOps as the core of AI Orchestration platforms for Enterprise AI
eBooks
Survey Report
State of ModelOps 2021
Learn the steps that any organization can take to successfully operationalize AI/ML or any other type of model.
4 Steps to Successful Model Operations
Learn the steps that any organization can take to successfully operationalize AI/ML or any other type of model.
The Key to Operationalizing AI at Enterprise Scale
This white paper explains what ModelOps is, and how it relates with MLOps, as a response to the growing need of clarity from organizations that are scaling, automating and governing Enterprise AI initiatives.
RFP
ModelOps & MLOps RFP Template
This document is an example RFP for addressing ModelOps (and MLOps) functional requirements. It is the result of interviews with several industry experts and analysts.
Executive Panels
CXO Panel
Governing, Integrating and Implementing Model, Data, AI & ML Initiatives
Shrikant Dash, Financial Services and Analytics Executive, leads a panel discussion with leading industry executives:
  • Ron Bodkin, VP AI engineering and CIO, Vector Institute,
  • Detin Karakus, Global head of quantitative and analytical soltuions, BP
  • Jacob Kosoff, Head of model risk, Regions Bank
  • Agus Sudjianto, EVP and head of coporate model risk, Wells Fargo
ModelOps Executive Panel Series #2
Bring Enterprise AI Initiatives into production with ModelOps
  • Leading Analyst view on the ModelOps space
  • Executive practitioners’ sharing their experiences on how to operationalize all models across the enterprise in a world with models of all types, regulations and the need for explainability and visibility.
  • Lessons learned, what has worked, what hasn’t, and how ModelOps is a key capability for enterprise AI to adapt and thrive in the new normal we are in.
Master Classes
ModelOps Master Class
Best Practices to Deploy, Monitor & Govern AI/ML Models
Stu Bailey, ModelOp co-founder and Chief AI Architect, covers the basics and best practices of ModelOps and how customers can scale and govern their models
ModelOps Technical Master Class
Become an Enterprise AI Architect
A series of 3 videos. Learn how to design model life cycles in real-life scenarios, including business KPIs and bias monitoring.
ModelOps Technical Master Class
ModelOps and MLOps Technical Deep Dive
A series of 5 videos. Learn how to deploy, monitor and govern AI and ML models. Take a deep dive into MLOps, which is a subset of ModelOps that is focused on managing machine learning models.
Connect with a ModelOps expert
Gartner Disclaimer
Any reference made to “ModelOps” is about model operations platforms, not the company ModelOp. Gartner does not endorse any vendor, product or service depicted in its research publications and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s Research & Advisory organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
A panel of Gartner analysts share how ModelOps makes enterprise AI initiatives more efficient and effective through governance, automation and orchestration.
Mike Gualtieri, Forrester analyst and Stu Bailey, ModelOp co-founder discuss the evolving role of ModelOps in enterprise AI initiatives
Shrikant Dash, Financial Services and Analytics Executive, leads a panel discussion with leading industry executives:
  • Ron Bodkin, VP AI engineering and CIO, Vector Institute,
  • Detin Karakus, Global head of quantitative and analytical soltuions, BP
  • Jacob Kosoff, Head of model risk, Regions Bank
  • Agus Sudjianto, EVP and head of coporate model risk, Wells Fargo
Resources
ModelOps Operations Focused
The Key to Operationalizing AI at Enterprise Scale
This white paper explains what ModelOps is, and how it relates with MLOps, as a response to the growing need of clarity from organizations that are scaling, automating and governing Enterprise AI initiatives.
ModelOps Governance Icon
ModelOps and MLOps Essentials
Learn what ModelOps and MLOps are and how it helps organizations are scale and governing their enterprise AI initiatives.
ModelOps Monitoring
ModelOps RFP
Looking for a ModelOps solution? Here’s an example RFP that addresses ModelOps and MLOps functional requirements. It was developed as a result of interviews with several industry experts and analysts.