Crawl History

Get first/last seen dates and total URL count for a domain.

GET /v1/crawl-history

Returns first/last seen dates and total URL count from the crawl index. Costs 2 credits.

Parameter	Type	Required	Description
`domain`	string	Yes	The domain to query

curl "https://api.rankparse.com/v1/crawl-history?domain=example.com" \
  -H "X-API-Key: rp_your_key"

{
  "data": {
    "first_seen": "2026-01-15",
    "last_seen": "2026-03-20",
    "total_urls": 4567
  },
  "credits_used": 2
}

Tech Stack

Get detected server, framework, and generator for a domain.

Status Codes

Get HTTP status code distribution for a domain.