wyrd/tools
esc

    ↑↓ Move ↵ Open seek results first Search by Pagefind
    Releases

    scrape

    Targeted page extraction — clean text, Markdown, or JSON from URLs you already have. Pick a provider subcommand.

    seek scrape <provider> <url...> [options]

    Providers: exa, parallel, firecrawl.

    scrape exa

    Bulk parsing — retrieves clean, stripped page text optimized for LLM token windows. Accepts multiple URLs.

    seek scrape exa https://example.com https://example.org
    OptionDescription
    -c, --chars <n>Max characters per page (default 50000)
    --jsonEmit raw JSON response

    Output: one Markdown block per URL (title, URL, text), separated by ---.

    scrape parallel

    Enterprise extraction via Parallel’s /v1/extract endpoint — clean markdown excerpts (and optional full content) plus publish dates per URL. Can authenticate through logins and paywalls. Accepts multiple URLs.

    seek scrape parallel https://app.example.com/dashboard \
      --objective "Extract the latest invoice table"
    OptionDescription
    --objective <text>Focus excerpts on a natural-language extraction goal
    --fullInclude full markdown content, not just excerpts
    -c, --chars <n>Max characters per excerpt block
    --max-total <n>Max characters total across all URLs
    --max-age <secs>Reuse cached content up to N seconds old
    --jsonEmit raw JSON response

    Output: one block per URL (title, URL, publish date, content), with any per-URL errors listed at the end.

    scrape firecrawl

    Turn a single live URL into clean Markdown, HTML, JSON, a summary, or a screenshot via Firecrawl v2.

    seek scrape firecrawl https://example.com -f markdown,links
    OptionDescription
    -f, --format <list>Comma-separated: markdown, html, rawHtml, links, summary, screenshot, video, audio (default markdown)
    --json-prompt <text>Add a JSON format with this LLM extraction prompt (produces data.json)
    --fullInclude nav/footer/sidebars (disables onlyMainContent)
    --wait <ms>Wait N ms for JS to render before scraping
    --mobileRender as a mobile viewport
    --block-adsBlock ads / trackers during render
    --proxy <mode>Proxy mode: basic | stealth | enhanced | auto
    --max-age <ms>Reuse cached scrape up to N ms old (cheaper, near-instant)
    --jsonEmit raw JSON response

    Takes a single URL. Output: the first available rendered format (markdown, then summary, html, links, JSON, or screenshot).