On-prem MLOps in a hospital: advice needed for production monitoring of self-built and vendor models? [D]

Excerpt

TL;DR: Hospital, fully on-prem OpenShift cluster. Multiple teams building prediction models, so we’re setting up a self-service platform with boundary policies. Evaluating ClearML vs OpenShift AI for the full MLOps lifecycle. Both look fine for development/deployment, but neither seems to give us production monitoring at the level we need (drift, bias, live dashboards per model). Extra twist: we also need to monitor models that run at our vendors, where all we get is an input/output data feed. L