The Crawl Tool
The Crawl Tool scans websites to easily find deeprooted user experience and SEO problems. The smartest SEO crawler is the ultimate tool to improve your web site
Install into your AI coding agent
Add this documentation directly to your development environment
AI Documentation Files
Access the llms.txt files for this website
The Crawl Tool scans websites to easily find deeprooted user experience and SEO problems. The smartest SEO crawler is the ultimate tool to improve your web site
Developer Tools
Explore tools created to help you work with llms.txt
- LLMs.txt Checker Chrome ExtensionCheck if websites implement llms.txt and llms-full.txt files
- LLMS.txt VSCode ExtensionSearch and explore llms.txt files directly in VS Code
- MCP LLMS.txt ExplorerExplore and analyze llms.txt files using MCP
- LLMs Txt Raycast ExtensionSearch and explore llms.txt files directly in Raycast
- llmstxt CLIInstall llms.txt documentation directly into your AI coding agents
Related Projects
Discover similar websites implementing llms.txt
Generate llms.txt files for your website to make it extractable, citable, and authoritative to AI systems like ChatGPT, Claude, Gemini, and Perplexity.
Your agent calls strale.do() and gets company data, compliance checks, financial validation — structured JSON with audit trails. 233+ capabilities, one API key.
Capability router for autonomous agents. Discover, invoke, and pay for AI services through one API with USDC settlement on Base L2.