scorpiox-docscore

Fetch and render URL content as markdown using a headless browser. Supports text, HTML, and markdown output formats with configurable page load wait times.

Linux x64 Linux ARM64 macOS ARM64

📖 Description

scorpiox-docs is a headless browser-based tool that fetches any URL and converts its rendered content into clean, readable markdown. It handles JavaScript-heavy pages, SPAs, and dynamic content by actually rendering pages in a real browser engine before extracting text. Output can be formatted as plain text, raw HTML, or structured markdown — making it ideal for feeding web documentation into AI agents, building knowledge bases, or archiving web content in a version-control-friendly format.

⚙️ Flags & Options (8)

Flag	Short	Description	Takes Value
`--output`	`-o`	Output file (default: stdout)	Yes
`--format`	`-f`	Output format: text, html, markdown (default: markdown)	Yes
`--wait`	`-w`	Wait time for page load in milliseconds (default: 3000)	Yes
`--help`	`-h`	Show this help	No
`--headless`	`—`	Run in headless mode (default: true)	No
`--no-headless`	`—`	Run with browser visible	No
`--check`	`—`	Check dependencies and exit	No
`--install`	`—`	Install missing dependencies	Yes

💡 Usage Examples

Basic: fetch a URL as markdown

# Fetch documentation page and output as markdown to stdout

$ scorpiox-docs https://docs.example.com/getting-started

# Getting Started

Welcome to the documentation...

Save output to a file

# Download and save a page as a markdown file

$ scorpiox-docs -o api-docs.md https://api.example.com/reference

Saved 2,847 bytes to api-docs.md

Choose output format

# Get raw HTML output

$ scorpiox-docs -f html https://example.com/page

# Get plain text (strips all formatting)

$ scorpiox-docs -f text https://example.com/page

# Explicitly request markdown (default)

$ scorpiox-docs -f markdown https://example.com/page

Wait for JavaScript-heavy pages

# SPA that needs extra time to render — wait 8 seconds

$ scorpiox-docs -w 8000 https://app.example.com/dashboard

# Fast static page — reduce wait to 1 second

$ scorpiox-docs --wait 1000 https://blog.example.com/post

Check and install dependencies

# Verify all required browser dependencies are installed

$ scorpiox-docs --check

✓ Chromium found at /usr/bin/chromium
✓ All dependencies satisfied

# Auto-install missing dependencies

$ scorpiox-docs --install auto

Debug: run with visible browser

# Open browser window to see rendering (useful for debugging)

$ scorpiox-docs --no-headless https://example.com

Piping into other tools

# Feed docs to an AI agent or search tool

$ scorpiox-docs https://docs.example.com/api | scorpiox-grep "authentication"

# Archive a full page into your project

$ scorpiox-docs -o docs/reference.md -f markdown https://lib.dev/docs

$ git add docs/reference.md && git commit -m "snapshot lib docs"

📦 Source & Build Info

Source File

scorpiox/scorpiox-docs.c

Lines of Code

512

Dependencies

libsxutil

Platforms

linux-x64 · linux-arm64 · macos-arm64

scorpiox-docscore

📖 Description

⚙️ Flags & Options (8)

💡 Usage Examples

📦 Source & Build Info

🔗 Related Tools