SiteOne Crawler

A cross-platform website crawler and analyzer for SEO, security, accessibility and performance, aimed at developers, DevOps and QA engineers and consultants. It runs on Windows, macOS and Linux, on x64 and arm64. The crawler follows every page and asset to identify errors such as missing pages and redirects, and a reporter can send HTML reports to an inbox through a built-in SMTP mailer. A CI mode applies a quality gate with configurable thresholds and returns exit code 10 on failure, so builds can stop automatically. Extra modes generate an offline copy of the pages, convert them to Markdown for backups, documentation or feeding to AI tools, and build a sitemap. An optional AI assistant and browser rendering are available. Written in Rust and MIT licensed.