parallel-web-extract

Extract content from multiple URLs in parallel, token-efficiently.

- Handles webpages, articles, PDFs, and JavaScript-heavy sites with a single command

- Runs in a forked context to minimize token overhead compared to built-in WebFetch

- Supports batch extraction of multiple URLs with optional focus objectives

- Requires parallel-cli installation and authentication; outputs extracted content as markdown to a local file for follow-up queries

URL Extraction

Extract content from: $ARGUMENTS

Command

Choose a short, descriptive filename based on the URL or content (e.g., vespa-docs, react-hooks-api). Use lowercase with hyphens, no spaces. Substitute it into the command inline - $FILENAME is a placeholder, not a shell variable.

parallel-cli extract "$ARGUMENTS" --json -o "/tmp/$FILENAME.json"

Concrete example:

parallel-cli extract "https://docs.parallel.ai" --json -o "/tmp/parallel-docs.json"

Note: -o always saves JSON. The extension must be .json.