Beaming Bog

A free, open source SEO crawler and website analyser inspired by Screaming Frog, built with Python in a modular architecture for performance and extensibility. Multi-threaded crawling runs in parallel with a configurable number of workers, and the SEO analysis identifies missing meta tags, duplicate content, broken links, redirect chains and more. Smart retry logic handles rate limiting gracefully. It can be used interactively or from the command line with arguments, and it documents examples, output and its architecture. The project invites questions and problems from users. It suits people who want a lightweight crawl of their own pages without paying for a desktop app.