Unverified50% confidenceFactExact time
Among the 549 top-1000 Tranco sites that return 2xx to ordinary browsers, 78 (14.2%) rejected at least one of GPTBot, OAI-SearchBot, ClaudeBot or PerplexityBot, even though their robots.txt explicitly allows these crawlers.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/15/2026
First Seen
Valid until: 1/13/2027
Sources
Related Entities
Cite This Claim
Stable URI
https://kongchang.com/claim/1040867API
curl https://kongchang.com/api/v1/knowledge/claims/1040867MCP
get_claim(id=1040867)