Guidelines for establishing reproducible and monitored machine learning pipelines using tools like MLflow.
Install
mkdir -p .claude/skills/mlops-observability && curl -L -o skill.zip "https://agentskills.codes/api/skills/download/2019" && unzip -o skill.zip -d .claude/skills/mlops-observability && rm skill.zipInstalls to .claude/skills/mlops-observability
Activation
This is the description your AI agent reads to decide when to run this skill — the better it matches your request, the more reliably it fires.
Guide to implement full stack observability including reproducibility, lineage, monitoring, alerting, and explainability.Key capabilities
- →Enforce reproducibility with fixed seeds
- →Track data lineage with MLflow
- →Implement drift detection with Evidently
- →Configure system alerts for production
- →Generate SHAP explainability artifacts
How it works
The skill provides a checklist and architectural patterns to integrate reproducibility, lineage tracking, monitoring, and explainability into ML workflows.
Inputs & outputs
When to use mlops-observability
- →Setting up model drift detection
- →Tracking ML experiment lineage and data versions
- →Configuring system alerts for production models
About mlops-observability
Provides architectural guidance for building 'Glass Box' ML systems. It covers versioning environments, tracking data lineage, and implementing drift detection to maintain model health.
Guide to implement full stack observability including reproducibility, lineage, monitoring, alerting, and explainability.
When not to use it
- →Non-ML projects
- →Simple script development without production requirements
Prerequisites
Limitations
- →Requires integration with specific libraries like MLflow
- →Dependent on infrastructure support for metrics
How it compares
It focuses on building a 'Glass Box' system with automated observability rather than manual logging.
Compared to similar skills
mlops-observability side by side with the closest alternatives in the catalog.
| Skill | Installs | Updated | Safety | Difficulty |
|---|---|---|---|---|
| mlops-observability (this skill) | 2 | 6mo | No flags | Advanced |
| langfuse | 7 | 6mo | No flags | Intermediate |
| langsmith-observability | 4 | 7mo | Review | Intermediate |
| trulens-instrumentation | 2 | 3mo | Review | Intermediate |
Try saying
Example prompts that trigger this skill in your AI assistant.
More by fmind
View all by fmind →You might also like
langfuse
davila7
Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production. Use when: langfuse, llm observability, llm tracing, prompt management, llm evaluation.
langsmith-observability
davila7
LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.
trulens-instrumentation
truera
Instrument LLM apps with TruLens OTEL-based tracing - from setup to debugging and optimization
distributed-tracing
wshobson
Implement distributed tracing with Jaeger and Tempo to track requests across microservices and identify performance bottlenecks. Use when debugging microservices, analyzing request flows, or implementing observability for distributed systems.
phoenix-observability
davila7
Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.
mlflow
davila7
Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform