Expired60% confidenceFactExact time
Ahrefs' crawler AhrefsBot has long ranked second only to Google in terms of internet crawler activity, and its backlink database covers more than 3 trillion links.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/21/2026
First Seen
Valid until: 10/19/2026(expired)
Sources
Related Claims
UnverifiedAhrefs' proprietary crawler AhrefsBot crawls more than 8 billion web pages per day.80% similarUnverifiedHTTPArchive conducts automated audits of millions of popular websites worldwide every month, with data stored in Google BigQuery and open for public queries.64% similarUnverifiedPreviously influential robot datasets, such as Google's RT series and the Open X-Embodiment project, typically range in scale from hundreds of thousands to millions of trajectories.64% similarUnverifiedThe 800 billion web pages preserved by the Internet Archive cover 30 years of internet evolution, contain a large amount of content that has disappeared from the live web, and have become a valuable corpus for training AI models.63% similarUnverifiedDoubleVerify在2024年的报告显示AI爬虫流量已占部分内容网站总流量的30%以上61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/579899API
curl https://kongchang.com/api/v1/knowledge/claims/579899MCP
get_claim(id=579899)