Unverified50% confidenceFactExact time
The RFC specification draft for robots.txt was not submitted by Google until 2022
1
Sources
50%
Confidence
Long-term
Relevance
8/4/2026
First Seen
Sources
Related Claims
Verifiedrobots.txt is an industry convention established in 1994 by the Robots Exclusion Protocol (REP) and is not a mandatory legal regulation, but mainstream search engines such as Google and Baidu strictly adhere to it72% similarUnverifiedThe llms.txt proposal that emerged in 2024 follows the conventions of robots.txt, providing project descriptions in plain-text Markdown format at a website's root directory to help LLMs build an understanding.67% similarUnverifiedGooglebot determines the scope of crawlable pages by following each website's robots.txt protocol; robots.txt is a text file stored in the root directory of a website used to declare crawlable or blocked pages to web crawlers.65% similarUnverifiedGoogle在2025年发表了PaperOrchestra论文，属于其'AI for Science'研究议程的一部分65% similarUnverifiedGoogle launched the first-generation Android Studio AI features to the public market in November 2024.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/682155API
curl https://kongchang.com/api/v1/knowledge/claims/682155MCP
get_claim(id=682155)