SpyWeb Documentation

SpyWeb

Zero-dependency web monitoring/scraping engine. Scrape, track, and get notified. ~7MB binary, no runtime, under 5MB idle RAM.

Get Started

GitHub

Features

Zero Dependencies

~7MB self-contained binary. Completely portable, no runtime required.

Lua Scripting

10 hook stages plus persistent storage for counters, cursors, and shared state.

Hot Reload

Save a config or Lua script and SpyWeb respawns the job instantly.

Browser Automation

Built-in CDP support for Chrome, Edge, or Brave. Scrape JS-rendered pages.

Multi-Worker

Per-job concurrency with URL queue mode and shared Lua state.

Dual Binary

Choice of headless CLI or silent system tray for background runs.

Quick Start

config.toml

name = "HN Front Page"
url = "https://news.ycombinator.com"
selector = ".athing"
fields = ["title:.titleline > a", "link:.titleline > a@href"]
keywords = ["rust", "linux", "open source"]

hooks.lua

function before_fetch(request, ctx)
    print("Fetching: " .. request.url)
    return request
end

defer.lua

function on_finally(ctx)
    print("Cycle finished")
end

spyweb start

See Job Configuration for all options, or Get Started for download commands.