ai-crawler-audit
A skill from the geo-doctor toolkit that checks whether AI crawlers such as GPTBot and ClaudeBot can fetch a given page and read its main text.
What the skill teaches
A skill from the geo-doctor toolkit that checks whether AI crawlers such as GPTBot and ClaudeBot can fetch a given page and read its main text. A bundled Node.js script with no dependencies requests the page, reads robots.txt, probes with AI crawler user agents and looks for noindex tags, firewall blocks, empty bodies and pages that only render with JavaScript, then scores the result from 0 to 100, capping it at 60 when a critical check fails. It can write a Markdown report, a badge or a share card and can fail a CI run below a threshold. The skill stresses that the score measures readability only, not ranking, and that untested items are marked unverified.
Capabilities
- Check robots.txt rules for AI crawlers
- Detect noindex, firewall blocks and JavaScript-only pages
- Score a page's AI readability from 0 to 100
- Write a Markdown audit report
About
- Publisher
- Fangx-AI
- Tool
- SEO
Install
The project doesn't document install steps that we could confirm. See the project's own instructions
What's inside
- LICENSE
- references/ai-sources-cn.md
- references/ai-sources-global.md
- references/crawler-access.md
- scripts/geo-audit.mjs
- scripts/proxy.mjs
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
This skill includes scripts that your agent may run.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | SEO | |
| Publisher | Fangx-AI | source |
| Official status | Not stated in its documentation | |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | Yes | source |
| Platforms | Not stated in its documentation | |
| AI clients | Not stated in its documentation | |
| Licence | MIT | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 9, 2026606 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository |
More from Fangx-AI
5 skills
All 5 from Fangx-AI →Also listed under: SEO
Sources
- Skill file (SKILL.md)github.com/fangx-ai/geo-doctor · Backs: Licence, Includes scriptsNov 17, 2026
- GitHub repositorygithub.com/fangx-ai/geo-doctor · Backs: Publisher, Activity, LicenceNov 11, 2026
- Skill file (SKILL.md)github.com/Fangx-AI/geo-doctorNov 17, 2026
- Folder in the repository (ai-crawler-audit)github.com/Fangx-AI/geo-doctor · Backs: Includes scriptsNov 17, 2026