ProductCapture Index API / Common Crawl CDX API
CDX API
An index metadata query interface provided by Common Crawl that allows users to query whether a specific URL has been crawled and indexed, along with details such as crawl timestamp and HTTP status code.
Timeline (last 90 days)
Oct 12
The CDX API (Capture Index API) is the standard interface for accessing Common Crawl index metadata; it can query whether a URL has been indexed, when it was indexed, and the HTTP status, but does not return the page content itself.
Unverified50%