Unverified50% confidenceFactExact time
GPTBot's server rejection rate was 14.4%, of which 11.1% occurred while robots.txt allowed it; ClaudeBot was rejected 14.8%, with 10.9% under allowance; PerplexityBot was rejected 11.3%, with 8.4% under allowance; OAI-SearchBot was rejected 9.8%, with 8.0% under allowance.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/15/2026
First Seen
Valid until: 1/13/2027
Sources
Related Entities
Related Claims
Unverified82.7% of reachable sites have a robots.txt; 25.1% block at least one search or answer crawler, and 10.2% block most of them; 26.0% block at least one training crawler, but only 2.6% block only training crawlers while keeping search and answer crawlers open; 2.5% carry Content-Signal directives, and 62.4% list a sitemap.71% similarUnverifiedCombining 403, 404 and rate limit (429) responses, at least 21.5% of AI bot requests currently end in client errors.59% similarUnverifiedIn 96% of levels, GPT-6 required fewer attempts to find the answer than the average person.56% similarUnverifiedSparkToro and Gumshoe.ai had 600 volunteers run 12 prompts across ChatGPT, Claude, and Google AI nearly 3,000 times, and the results showed that the probability of getting the same brand list twice was less than 1/100, and the probability of getting the same ranking was close to 1/1000.56% similarUnverifiedMost AI programming assistants currently only provide aggregated percentages and lack per-request consumption records.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1040869API
curl https://kongchang.com/api/v1/knowledge/claims/1040869MCP
get_claim(id=1040869)