When a domain first and last appeared in the Wayback Machine archive, and how large its archive footprint is.

GET/v1/crawl-history2 creditsAPI key

Looks up a domain in the Internet Archive's Wayback Machine CDX index and returns its earliest and latest snapshot dates plus a snapshot count. Use it as a quick age and longevity signal when evaluating a domain. The data comes live from web.archive.org, not from RankParse's link graph.

Request

Parameters

Name	Type	Required	Default	Description
`domain`	string	Yes	none	Bare domain such as `stripe.com`. The query covers every archived URL under it (`domain/*`).

Example

curl "https://api.rankparse.com/v1/crawl-history?domain=stripe.com" \
  -H "X-API-Key: rp_your_key"

import requests

resp = requests.get(
    "https://api.rankparse.com/v1/crawl-history",
    params={"domain": "stripe.com"},
    headers={"X-API-Key": "rp_your_key"},
    timeout=60,
)
resp.raise_for_status()
history = resp.json()["data"]
print(history["first_seen"], history["last_seen"])

const res = await fetch(
  "https://api.rankparse.com/v1/crawl-history?domain=stripe.com",
  { headers: { "X-API-Key": process.env.RANKPARSE_API_KEY } }
);
if (!res.ok) throw new Error(`${res.status}: ${await res.text()}`);
const { data } = await res.json();
console.log(data.first_seen, data.last_seen);

Response

{
  "domain": "stripe.com",
  "data": {
    "domain": "stripe.com",
    "first_seen": "2009-11-14",
    "last_seen": "2026-09-30",
    "total_snapshots": 4231,
    "source": "wayback_machine"
  },
  "credits_used": 2,
  "credits_remaining": 998
}

Response fields

Field	Type	Description
`first_seen`	string or null	Date of the earliest archived snapshot, `YYYY-MM-DD`.
`last_seen`	string or null	Date of the most recent archived snapshot, `YYYY-MM-DD`.
`total_snapshots`	integer	Archive size indicator taken from the CDX index's pagination count. Treat it as approximate and use it for relative comparison, not exact accounting. `0` when unavailable.
`source`	string	Always `wayback_machine`.

Behavior and limits

No history is not an error. A domain the archive has never seen returns 200 with first_seen: null, last_seen: null and total_snapshots: 0. You are still charged 2 credits.
Archive outages degrade quietly. The three CDX lookups run in parallel and each is optional. If the Wayback Machine is slow or unreachable, the affected fields come back null or 0 with a 200 rather than an error, and the call is still billed. Retry later if a well-known domain shows no history.
Dates are UTC snapshot dates, not crawl times of RankParse.
Subject to the standard 60 requests per minute limit and to Wayback Machine's own availability. Responses are not cached by RankParse.

Errors

Status	Code	When
`400`	`invalid_domain`	`domain` is missing or not a valid bare domain.
`401`	`invalid_api_key`	Missing, invalid or revoked key.
`402`	`insufficient_credits`	Balance below 2 credits.
`402`	`spend_cap_reached`	Monthly spend cap reached.
`429`	`rate_limited`	More than 60 requests per minute.

See Errors for the shared error format. Send a valid bare domain: validate on your side before calling.

MCP tool: get_crawl_history.

Domain Authority

Authority score, plus registration date from RDAP.

Free tools

Domain age lookup from registration data.

Crawl History