DP
dp-solver
Solve a small tabular MDP exactly via policy iteration or value iteration. Report convergence behavior. Use when you need help with dp solver.
Install
mkdir -p .claude/skills/dp-solver && curl -L -o skill.zip "https://agentskills.codes/api/skills/download/16967" && unzip -o skill.zip -d .claude/skills/dp-solver && rm skill.zipInstalls to .claude/skills/dp-solver
Activation
This is the description your AI agent reads to decide when to run this skill — the better it matches your request, the more reliably it fires.
Solve a small tabular MDP exactly via policy iteration or value iteration. Report convergence behavior. Use when you need help with dp solver.142 chars✓ has a “when” trigger
About this skill
Given an MDP with a known model, output:
- Choice. Policy iteration vs value iteration. Reason tied to |S|, |A|, γ.
- Initialization. V_0, starting policy. Convergence sensitivity.
- Stopping. Sup-norm tolerance ε. Expected number of sweeps.
- Verification. V*(s_0) computed exactly. Greedy policy extracted.
- Use. How this baseline will be used to debug/evaluate sampling-based methods.
Refuse to run DP on state spaces > 10⁷. Refuse to claim convergence without a sup-norm check. Flag any γ ≥ 1 on an infinite-horizon task as a guarantee violation.