you-chang.com.tw — AI 爬蟲準備度
you-chang.com.tw 的公開 AI 爬蟲準備度報告：分數、機器人存取、探索檔案與改善建議。
準備度摘要
分數: 80/100 · 等級: A-
最近檢查:
AI 爬蟲存取
- CCBot — 允許 (Common Crawl)
- AI2Bot — 允許 (Allen Institute for AI)
- GPTBot — 允許 (OpenAI)
- YouBot — 允許 (You.com)
- Diffbot — 允許 (Diffbot)
- Timpibot — 允許 (Timpi)
- Amazonbot — 允許 (Amazon)
- ClaudeBot — 允許 (Anthropic)
- Cohere-ai — 允許 (Cohere)
- Omgilibot — 允許 (Webz.io)
- Bytespider — 允許 (ByteDance)
- Claude-User — 允許 (Anthropic)
- FacebookBot — 允許 (Meta)
- ChatGPT-User — 允許 (OpenAI)
- ImagesiftBot — 允許 (Hive / ImageSift)
- anthropic-ai — 允許 (Anthropic)
- DuckAssistBot — 允許 (DuckDuckGo)
- OAI-SearchBot — 允許 (OpenAI)
- PerplexityBot — 允許 (Perplexity)
- Google-Extended — 允許 (Google)
- Perplexity-User — 允許 (Perplexity)
- Claude-SearchBot — 允許 (Anthropic)
- Applebot-Extended — 允許 (Apple)
- Meta-ExternalAgent — 允許 (Meta)
- Meta-ExternalFetcher — 允許 (Meta)
探索與頁面訊號
- llms.txt: ✓
- ai.txt: ✕
- JSON-LD: ✓
- FAQ Schema: ✓
- Meta description: ✓
- Open Graph: ✓
改善建議
- Live AI-crawler probe blocked/unreachable for: GPTBot (HTTP 403), ClaudeBot (HTTP 403). Your server or WAF may block AI bots even when robots.txt allows them.
- Optional: add /ai.txt for AI usage policies