nz.cricinfo.com
robots.txt
Robots Exclusion Standard data for nz.cricinfo.com
Resource Scan
Scan Details
Site Domain | nz.cricinfo.com |
Base Domain | cricinfo.com |
Scan Status | Ok |
Last Scan | 2024-11-02T09:41:22+00:00 |
Next Scan | 2024-11-09T09:41:22+00:00 |
Last Scan
Scanned | 2024-11-02T09:41:22+00:00 |
URL | https://nz.cricinfo.com/robots.txt |
Redirect | https://www.espncricinfo.com/robots.txt |
Redirect Domain | www.espncricinfo.com |
Redirect Base | espncricinfo.com |
Domain IPs | 3.0.170.153, 52.77.200.174 |
Redirect IPs | 184.50.85.132, 184.50.85.156, 184.50.85.177, 2600:1413:1::6011:b421, 2600:1413:1::6011:b4b4, 2600:1413:1::6011:b4b8, 2600:1413:1::b832:55a2, 2600:1413:1::b832:55b1, 96.17.180.130, 96.17.180.184 |
Response IP | 96.17.180.184 |
Found | Yes |
Hash | 5ecc6bb7e74d25f820bae4429fd3c5e367a9bb1eb146093656f007c8618115ca |
SimHash | e94e2864c285 |
Groups
*
Rule | Path |
---|---|
Allow | /* |
Disallow | /*wrappertype%3Dprint |
Disallow | /*/content/url/ |
Disallow | /*/content/current/url/ |
Disallow | /error |
Disallow | /fragments/ |
Disallow | /logos/ |
Disallow | /country-fragment/ |
Disallow | /country-fragment2/ |
Disallow | /cgi-bin/ |
Disallow | /classes/ |
Disallow | /format/ |
Disallow | /frames/ |
Disallow | /db/HELPFILES/ |
Disallow | /db/MANAGEMENT/ |
Disallow | /db/MISC/CRICINFO_DATA/ |
Disallow | /db/SUPPORT/ADVERTS/ |
Disallow | /db/SUPPORT/AFP/ |
Disallow | /db/SUPPORT/BSTAR/ |
Disallow | /db/SUPPORT/DAWN/ |
Disallow | /db/SUPPORT/DAWSON/ |
Disallow | /db/SUPPORT/ET/ |
Disallow | /db/SUPPORT/JAGGED/ |
Disallow | /db/SUPPORT/SHOP/ |
Disallow | /db/ARCHIVE/ |
Disallow | /db/INTERACTIVE/ |
Disallow | /db/NATIONAL/ |
Disallow | /db/photos/ |
Disallow | /greatestallrounder/ |
Disallow | /icc_cricket_worldcup2011/ |
Disallow | /radio/ |
Disallow | /games/content/site/games/ |
Disallow | /hsbcview/ |
Disallow | /hsbcviews/ |
Disallow | /internal_applications/ |
Disallow | /series/india-tour-of-south-africa-2013-14-648627/ |
Disallow | /audio/ |
Disallow | /video/ |
Disallow | /barbados/ |
Disallow | /*?cmp |
Disallow | /*?addata |
Disallow | /*?wrappertype=print |
Other Records
Field | Value |
---|---|
sitemap | https://www.espncricinfo.com/sitemap.xml |