nz.cricinfo.com
robots.txt

Robots Exclusion Standard data for nz.cricinfo.com

Resource Scan

Scan Details

Site Domain nz.cricinfo.com
Base Domain cricinfo.com
Scan Status Ok
Last Scan2024-11-02T09:41:22+00:00
Next Scan 2024-11-09T09:41:22+00:00

Last Scan

Scanned2024-11-02T09:41:22+00:00
URL https://nz.cricinfo.com/robots.txt
Redirect https://www.espncricinfo.com/robots.txt
Redirect Domain www.espncricinfo.com
Redirect Base espncricinfo.com
Domain IPs 3.0.170.153, 52.77.200.174
Redirect IPs 184.50.85.132, 184.50.85.156, 184.50.85.177, 2600:1413:1::6011:b421, 2600:1413:1::6011:b4b4, 2600:1413:1::6011:b4b8, 2600:1413:1::b832:55a2, 2600:1413:1::b832:55b1, 96.17.180.130, 96.17.180.184
Response IP 96.17.180.184
Found Yes
Hash 5ecc6bb7e74d25f820bae4429fd3c5e367a9bb1eb146093656f007c8618115ca
SimHash e94e2864c285

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Allow /*
Disallow /*wrappertype%3Dprint
Disallow /*/content/url/
Disallow /*/content/current/url/
Disallow /error
Disallow /fragments/
Disallow /logos/
Disallow /country-fragment/
Disallow /country-fragment2/
Disallow /cgi-bin/
Disallow /classes/
Disallow /format/
Disallow /frames/
Disallow /db/HELPFILES/
Disallow /db/MANAGEMENT/
Disallow /db/MISC/CRICINFO_DATA/
Disallow /db/SUPPORT/ADVERTS/
Disallow /db/SUPPORT/AFP/
Disallow /db/SUPPORT/BSTAR/
Disallow /db/SUPPORT/DAWN/
Disallow /db/SUPPORT/DAWSON/
Disallow /db/SUPPORT/ET/
Disallow /db/SUPPORT/JAGGED/
Disallow /db/SUPPORT/SHOP/
Disallow /db/ARCHIVE/
Disallow /db/INTERACTIVE/
Disallow /db/NATIONAL/
Disallow /db/photos/
Disallow /greatestallrounder/
Disallow /icc_cricket_worldcup2011/
Disallow /radio/
Disallow /games/content/site/games/
Disallow /hsbcview/
Disallow /hsbcviews/
Disallow /internal_applications/
Disallow /series/india-tour-of-south-africa-2013-14-648627/
Disallow /audio/
Disallow /video/
Disallow /barbados/
Disallow /*?cmp
Disallow /*?addata
Disallow /*?wrappertype=print

Other Records

Field Value
sitemap https://www.espncricinfo.com/sitemap.xml