wisden.com
robots.txt
Robots Exclusion Standard data for wisden.com
Resource Scan
Scan Details
Site Domain | wisden.com |
Base Domain | wisden.com |
Scan Status | Ok |
Last Scan | 2025-09-07T18:04:10+00:00 |
Next Scan | 2025-09-14T18:04:10+00:00 |
Last Scan
Scanned | 2025-09-07T18:04:10+00:00 |
URL | https://wisden.com/robots.txt |
Redirect | https://www.wisden.com/robots.txt |
Redirect Domain | www.wisden.com |
Redirect Base | wisden.com |
Domain IPs | 104.26.14.119, 104.26.15.119, 172.67.68.21, 2606:4700:20::681a:e77, 2606:4700:20::681a:f77, 2606:4700:20::ac43:4415 |
Redirect IPs | 23.54.118.37, 23.54.118.51, 2600:1413:5000:12::1737:27e6, 2600:1413:5000:12::1737:27f0 |
Response IP | 23.55.44.140 |
Found | Yes |
Hash | c7af6a0833de63030a0ecc94ebe861c29d7495de13c7d10c6acf45a0fe9e319d |
SimHash | d4040a204735 |
Groups
*
Rule | Path |
---|---|
Allow | |
Disallow | */page/*?loadmore=* |
Disallow | *search?q= |
Disallow | /cricket/v1/* |
Disallow | /apiv3/* |
Disallow | /apiv4/* |
Disallow | /default.aspx* |
Disallow | /functions/wallstream/* |