Unverified50% confidenceFactExact time
Google-Extended and Applebot-Extended are not crawlers but control tokens in robots.txt, used to decide whether content crawled by Googlebot and Applebot can be used for Gemini or Apple model training, and they do not appear in server logs
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGoogle-Extended is a robots.txt product token introduced by Google in September 2023 to control training and grounding of Google's Gemini models, and it is a completely separate token from Googlebot.73% similarUnverifiedGoogle-Extended controls whether Google can use content for Gemini model training and grounding; it does not affect Google Search or AI Overviews, which use the regular Googlebot.71% similarUnverifiedGoogle has introduced the googlebot series of directive extensions, and some platforms support values such as noindex and nosnippet in the robots meta tag.68% similarUnverifiedGooglebot and Google-Extended each serve different systems, and crawling behavior is separate from ranking and AI feature display.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1028525API
curl https://kongchang.com/api/v1/knowledge/claims/1028525MCP
get_claim(id=1028525)