Scouter SEO Crawler

A full featured SEO crawler you run on your own server, described as Screaming Frog reimagined as a web app that is multi-user, multi-project, free and fully open source. Built by an SEO consultant for SEO consultants and developers, it includes an MCP server so Claude, Cursor or any MCP client can trigger crawls, query results, recategorise pages and generate reports. A chatbot called Dr. Brief analyses a crawl conversationally, pages can be auto categorised by intent, template or a custom taxonomy, and AI bulk generation creates content from a crawl. It works with OpenAI, Anthropic, Gemini or local models through Ollama and vLLM, and offers custom extraction. A demo video shows it crawling and chatting with a real site. Written in PHP under the MIT license.