scorpiox-docs

Network

Fetch URL content from any URL using a headless browser. Supports rendering JavaScript-heavy pages, extracting text, HTML, or Markdown output with configurable wait times.

Linux x64Linux ARM64macOS ARM64Windows x64

Flags & Options

Flag	Short	Description	Takes Value
`--check`		Check dependencies and exit	No
`--format`	`-f`	Output format: text, html, or markdown	Yes
`--headless`		Run in headless mode (default)	No
`--help`	`-h`	Show help message	Yes
`--install`		Install missing dependencies	No
`--no-headless`		Run with browser visible	No
`--output`	`-o`	Write output to file instead of stdout	Yes
`--wait`	`-w`	Wait time in ms for page load (default: 3000)	Yes

Usage Examples

Basic — Fetch a URL as Markdown

# Fetch documentation page and output as markdown scorpiox-docs https://docs.python.org/3/library/json.html # Output is printed to stdout in markdown format by default

Specify output format

# Get raw HTML scorpiox-docs --format html https://example.com # Get plain text (no markup) scorpiox-docs -f text https://developer.mozilla.org/en-US/docs/Web/HTML

Save output to file

# Save fetched content to a local file scorpiox-docs -o api-docs.md https://api.github.com/docs # Combine with format flag scorpiox-docs --format html --output page.html https://example.com

Wait for JavaScript rendering

# Wait 5 seconds for JS-heavy SPA to fully render scorpiox-docs --wait 5000 https://app.example.com/dashboard # Short form — wait 10 seconds for slow pages scorpiox-docs -w 10000 -f markdown https://react-app.example.com

Debug with visible browser

# Run with browser window visible for debugging scorpiox-docs --no-headless https://example.com # Check if browser dependencies are installed scorpiox-docs --check # Install missing dependencies automatically scorpiox-docs --install

Pipeline usage

# Pipe URL content into other tools scorpiox-docs https://changelog.com/releases | grep "v2." # Feed documentation to an AI agent for analysis scorpiox-docs -f text https://docs.example.com/api | scorpiox-agent analyze

Source & Build Info

Source File

scorpiox/scorpiox-docs.c

Lines of Code

464

Dependencies

libsxutil

scorpiox-docs

Flags & Options

Usage Examples

Source & Build Info

Related Tools