aus.cricinfo.com
robots.txt
Robots Exclusion Standard data for aus.cricinfo.com
Resource Scan
Scan Details
| Site Domain | aus.cricinfo.com |
| Base Domain | cricinfo.com |
| Scan Status | Ok |
| Last Scan | 2024-11-06T06:49:15+00:00 |
| Next Scan | 2024-11-13T06:49:15+00:00 |
Last Scan
| Scanned | 2024-11-06T06:49:15+00:00 |
| URL | https://aus.cricinfo.com/robots.txt |
| Redirect | https://www.espncricinfo.com/robots.txt |
| Redirect Domain | www.espncricinfo.com |
| Redirect Base | espncricinfo.com |
| Domain IPs | 13.215.17.156, 3.0.170.153 |
| Redirect IPs | 23.215.7.11, 23.215.7.29, 2600:1413:b000:1c::17d1:2ed0, 2600:1413:b000:1c::17d1:2edb |
| Response IP | 23.59.168.129 |
| Found | Yes |
| Hash | 5ecc6bb7e74d25f820bae4429fd3c5e367a9bb1eb146093656f007c8618115ca |
| SimHash | e94e2864c285 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /* |
| Disallow | /*wrappertype%3Dprint |
| Disallow | /*/content/url/ |
| Disallow | /*/content/current/url/ |
| Disallow | /error |
| Disallow | /fragments/ |
| Disallow | /logos/ |
| Disallow | /country-fragment/ |
| Disallow | /country-fragment2/ |
| Disallow | /cgi-bin/ |
| Disallow | /classes/ |
| Disallow | /format/ |
| Disallow | /frames/ |
| Disallow | /db/HELPFILES/ |
| Disallow | /db/MANAGEMENT/ |
| Disallow | /db/MISC/CRICINFO_DATA/ |
| Disallow | /db/SUPPORT/ADVERTS/ |
| Disallow | /db/SUPPORT/AFP/ |
| Disallow | /db/SUPPORT/BSTAR/ |
| Disallow | /db/SUPPORT/DAWN/ |
| Disallow | /db/SUPPORT/DAWSON/ |
| Disallow | /db/SUPPORT/ET/ |
| Disallow | /db/SUPPORT/JAGGED/ |
| Disallow | /db/SUPPORT/SHOP/ |
| Disallow | /db/ARCHIVE/ |
| Disallow | /db/INTERACTIVE/ |
| Disallow | /db/NATIONAL/ |
| Disallow | /db/photos/ |
| Disallow | /greatestallrounder/ |
| Disallow | /icc_cricket_worldcup2011/ |
| Disallow | /radio/ |
| Disallow | /games/content/site/games/ |
| Disallow | /hsbcview/ |
| Disallow | /hsbcviews/ |
| Disallow | /internal_applications/ |
| Disallow | /series/india-tour-of-south-africa-2013-14-648627/ |
| Disallow | /audio/ |
| Disallow | /video/ |
| Disallow | /barbados/ |
| Disallow | /*?cmp |
| Disallow | /*?addata |
| Disallow | /*?wrappertype=print |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.espncricinfo.com/sitemap.xml |