PA

Facilitates automated web scraping operations using Parsehub and Rube MCP.

Install

mkdir -p .claude/skills/parsehub-automation && curl -L -o skill.zip "https://agentskills.codes/api/skills/download/11022" && unzip -o skill.zip -d .claude/skills/parsehub-automation && rm skill.zip

Installs to .claude/skills/parsehub-automation

Activation

This is the description your AI agent reads to decide when to run this skill — the better it matches your request, the more reliably it fires.

Automate Parsehub tasks via Rube MCP (Composio). Always search tools first for current schemas.
95 charsno explicit “when” trigger
Intermediate

Key capabilities

  • Trigger extraction runs
  • Monitor job status
  • Fetch scraped data

How it works

It uses Rube MCP to manage Parsehub extraction jobs.

Inputs & outputs

You give it
Extraction task
You get back
Scraped data

When to use parsehub-automation

  • Trigger web scraping runs
  • Monitor extraction job status
  • Fetch scraped data results

About this skill

Parsehub Automation via Rube MCP

Automate Parsehub operations through Composio's Parsehub toolkit via Rube MCP.

Toolkit docs: composio.dev/toolkits/parsehub

Prerequisites

  • Rube MCP must be connected (RUBE_SEARCH_TOOLS available)
  • Active Parsehub connection via RUBE_MANAGE_CONNECTIONS with toolkit parsehub
  • Always call RUBE_SEARCH_TOOLS first to get current tool schemas

Setup

Get Rube MCP: Add https://rube.app/mcp as an MCP server in your client configuration. No API keys needed — just add the endpoint and it works.

  1. Verify Rube MCP is available by confirming RUBE_SEARCH_TOOLS responds
  2. Call RUBE_MANAGE_CONNECTIONS with toolkit parsehub
  3. If connection is not ACTIVE, follow the returned auth link to complete setup
  4. Confirm connection status shows ACTIVE before running any workflows

Tool Discovery

Always discover available tools before executing workflows:

RUBE_SEARCH_TOOLS
queries: [{use_case: "Parsehub operations", known_fields: ""}]
session: {generate_id: true}

This returns available tool slugs, input schemas, recommended execution plans, and known pitfalls.

Core Workflow Pattern

Step 1: Discover Available Tools

RUBE_SEARCH_TOOLS
queries: [{use_case: "your specific Parsehub task"}]
session: {id: "existing_session_id"}

Step 2: Check Connection

RUBE_MANAGE_CONNECTIONS
toolkits: ["parsehub"]
session_id: "your_session_id"

Step 3: Execute Tools

RUBE_MULTI_EXECUTE_TOOL
tools: [{
  tool_slug: "TOOL_SLUG_FROM_SEARCH",
  arguments: {/* schema-compliant args from search results */}
}]
memory: {}
session_id: "your_session_id"

Known Pitfalls

  • Always search first: Tool schemas change. Never hardcode tool slugs or arguments without calling RUBE_SEARCH_TOOLS
  • Check connection: Verify RUBE_MANAGE_CONNECTIONS shows ACTIVE status before executing tools
  • Schema compliance: Use exact field names and types from the search results
  • Memory parameter: Always include memory in RUBE_MULTI_EXECUTE_TOOL calls, even if empty ({})
  • Session reuse: Reuse session IDs within a workflow. Generate new ones for new workflows
  • Pagination: Check responses for pagination tokens and continue fetching until complete

Quick Reference

OperationApproach
Find toolsRUBE_SEARCH_TOOLS with Parsehub-specific use case
ConnectRUBE_MANAGE_CONNECTIONS with toolkit parsehub
ExecuteRUBE_MULTI_EXECUTE_TOOL with discovered tool slugs
Bulk opsRUBE_REMOTE_WORKBENCH with run_composio_tool()
Full schemaRUBE_GET_TOOL_SCHEMAS for tools with schemaRef

Powered by Composio

When not to use it

  • Direct web scraping
  • Data cleaning

Prerequisites

Parsehub connection

Limitations

  • Requires Parsehub project
  • Limited by scraping targets

How it compares

It provides a standardized interface for automating web scraping workflows.

Compared to similar skills

parsehub-automation side by side with the closest alternatives in the catalog.

SkillInstallsUpdatedSafetyDifficulty
parsehub-automation (this skill)05moNo flagsIntermediate
crawl4ai218moReviewIntermediate
apify93moReviewIntermediate
web-scraper03moReviewIntermediate

Try saying

Example prompts that trigger this skill in your AI assistant.

More by diegosouzapw

View all by diegosouzapw

helm-chart-scaffolding-v2

diegosouzapw

Helm Chart Scaffolding workflow skill. Use this skill when the user needs Comprehensive guidance for creating, organizing, and managing Helm charts for packaging and deploying Kubernetes applications and the operator should preserve the upstream workflow, copied support files, and provenance before

00

cc-skill-coding-standards-v2

diegosouzapw

Coding Standards & Best Practices workflow skill. Use this skill when the user needs Universal coding standards, best practices, and patterns for TypeScript, JavaScript, React, and Node.js development and the operator should preserve the upstream workflow, copied support files, and provenance before

00

worktree-setup

diegosouzapw

Automatically invoked after `git worktree add` to create data/shared symlink and data/local directory. Required before starting work in any new worktree.

00

signalwire-agents-sdk

diegosouzapw

Expert assistance for building SignalWire AI Agents in Python. Automatically activates when working with AgentBase, SWAIG functions, skills, SWML, voice configuration, DataMap, or any signalwire_agents code. Provides patterns, best practices, and complete working examples.

00

agent-sales-engineer

diegosouzapw

Expert sales engineer specializing in technical pre-sales, solution architecture, and proof of concepts. Masters technical demonstrations, competitive positioning, and translating complex technology into business value for prospects and customers.

00

frontend-design

diegosouzapw

Create distinctive, production-grade frontend interfaces with high design quality. Avoids generic AI aesthetics in favor of bold, memorable designs.

00

Search skills

Search the agent skills registry