ssl.espncricinfo.com
robots.txt
Robots Exclusion Standard data for ssl.espncricinfo.com
Resource Scan
Scan Details
| Site Domain | ssl.espncricinfo.com |
| Base Domain | espncricinfo.com |
| Scan Status | Ok |
| Last Scan | 2024-04-27T05:00:38+00:00 |
| Next Scan | 2024-05-04T05:00:38+00:00 |
Last Scan
| Scanned | 2024-04-27T05:00:38+00:00 |
| URL | https://ssl.espncricinfo.com/robots.txt |
| Redirect | https://www.espncricinfo.com/robots.txt |
| Redirect Domain | www.espncricinfo.com |
| Redirect Base | espncricinfo.com |
| Domain IPs | 13.251.228.132, 2400:6500:ff00::36fe:cd4d, 2400:6500:ff00::dfb:e484, 54.254.205.77 |
| Redirect IPs | 184.50.85.130, 184.50.85.162, 2600:1413:b000:1c::17d1:2ec8, 2600:1413:b000:1c::17d1:2ed3 |
| Response IP | 184.50.85.130 |
| Found | Yes |
| Hash | 5ecc6bb7e74d25f820bae4429fd3c5e367a9bb1eb146093656f007c8618115ca |
| SimHash | e94e2864c285 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /* |
| Disallow | /*wrappertype%3Dprint |
| Disallow | /*/content/url/ |
| Disallow | /*/content/current/url/ |
| Disallow | /error |
| Disallow | /fragments/ |
| Disallow | /logos/ |
| Disallow | /country-fragment/ |
| Disallow | /country-fragment2/ |
| Disallow | /cgi-bin/ |
| Disallow | /classes/ |
| Disallow | /format/ |
| Disallow | /frames/ |
| Disallow | /db/HELPFILES/ |
| Disallow | /db/MANAGEMENT/ |
| Disallow | /db/MISC/CRICINFO_DATA/ |
| Disallow | /db/SUPPORT/ADVERTS/ |
| Disallow | /db/SUPPORT/AFP/ |
| Disallow | /db/SUPPORT/BSTAR/ |
| Disallow | /db/SUPPORT/DAWN/ |
| Disallow | /db/SUPPORT/DAWSON/ |
| Disallow | /db/SUPPORT/ET/ |
| Disallow | /db/SUPPORT/JAGGED/ |
| Disallow | /db/SUPPORT/SHOP/ |
| Disallow | /db/ARCHIVE/ |
| Disallow | /db/INTERACTIVE/ |
| Disallow | /db/NATIONAL/ |
| Disallow | /db/photos/ |
| Disallow | /greatestallrounder/ |
| Disallow | /icc_cricket_worldcup2011/ |
| Disallow | /radio/ |
| Disallow | /games/content/site/games/ |
| Disallow | /hsbcview/ |
| Disallow | /hsbcviews/ |
| Disallow | /internal_applications/ |
| Disallow | /series/india-tour-of-south-africa-2013-14-648627/ |
| Disallow | /audio/ |
| Disallow | /video/ |
| Disallow | /barbados/ |
| Disallow | /*?cmp |
| Disallow | /*?addata |
| Disallow | /*?wrappertype=print |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.espncricinfo.com/sitemap.xml |