Find your symptom below. If a file of yours breaks a script, Claude shows the error; the fixes below cover the common causes.
| Symptom | Fix |
|---|---|
| The crawl stops early | It respects robots.txt and a page cap. Raise the cap in your request, or check robots.txt blocks. |
| Every bot shows blocked | Your firewall or CDN may challenge all non-browser traffic. Check its bot settings; the report says which bots got a challenge page. |
| Claude.ai cannot reach the site | Claude's sandbox may have no internet. Use Claude Code, or save the pages and audit with --local-dir. |
| Claude answers without running a script | Check the skill is toggled on under Customize > Skills and code execution is on. Then ask again and name the job, e.g. "use the ai-crawler-access skill". |
ModuleNotFoundError: pandas in Claude Code |
Run pip install pandas openpyxl in the Python that Claude Code uses. Claude.ai and the API already have them. |
| No PNG charts in the output | matplotlib is missing. Everything else still works; install matplotlib if you want charts. |
| Upload fails in claude.ai | Upload the small zips inside claude-ai-uploads/, one per skill, not the whole pack zip. |
python tests/run_tests.py shows fewer than 41/41 |
Run it from the pack folder with Python 3.9+, pandas and openpyxl installed. If it still fails, compare tests/run_log.txt with TESTS.md. |
FAQ
Will this improve my rankings? It finds technical blockers and missing signals. It cannot promise rankings.
Can I audit a competitor's site? Only audit sites you own or have permission to audit.
Do I need to code? No. You upload the skills once, then attach files in a chat and ask in plain words.
Does it send my data anywhere? The crawler visits only the site you ask it to audit, politely (robots.txt respected, delay, page cap). No other network calls and no paid APIs.
Which Claude plans work? Any plan where Skills and code execution are on (Pro, Max, Team, Enterprise), Claude Code, or the Claude API with the code-execution tool.
Where do I get help? This file and README.md. There is no call, chat or email support. Fixes ship as new versions at your download link; CHANGELOG.md lists them.