thecricketmonthly.com
robots.txt
Robots Exclusion Standard data for thecricketmonthly.com
Resource Scan
Scan Details
| Site Domain | thecricketmonthly.com |
| Base Domain | thecricketmonthly.com |
| Scan Status | Ok |
| Last Scan | 2024-05-15T17:21:37+00:00 |
| Next Scan | 2024-05-22T17:21:37+00:00 |
Last Scan
| Scanned | 2024-05-15T17:21:37+00:00 |
| URL | https://thecricketmonthly.com/robots.txt |
| Redirect | https://www.thecricketmonthly.com/robots.txt |
| Redirect Domain | www.thecricketmonthly.com |
| Redirect Base | thecricketmonthly.com |
| Domain IPs | 18.141.95.101, 52.76.210.190 |
| Redirect IPs | 23.32.29.9, 2600:1413:b000:1b::17d7:706, 2600:1413:b000:1b::17d7:71a, 96.17.180.45 |
| Response IP | 23.52.40.27 |
| Found | Yes |
| Hash | f595b9d15b106cb8249a59a1e137f65ed59f5d428d86fe994d3aa5b9555f8c4f |
| SimHash | ed462a64c285 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /* |
| Disallow | /*wrappertype%3Dprint |
| Disallow | /*/content/url/ |
| Disallow | /*/content/current/url/ |
| Disallow | /error |
| Disallow | /fragments/ |
| Disallow | /logos/ |
| Disallow | /country-fragment/ |
| Disallow | /country-fragment2/ |
| Disallow | /cgi-bin/ |
| Disallow | /classes/ |
| Disallow | /format/ |
| Disallow | /frames/ |
| Disallow | /db/HELPFILES/ |
| Disallow | /db/MANAGEMENT/ |
| Disallow | /db/MISC/CRICINFO_DATA/ |
| Disallow | /db/SUPPORT/ADVERTS/ |
| Disallow | /db/SUPPORT/AFP/ |
| Disallow | /db/SUPPORT/BSTAR/ |
| Disallow | /db/SUPPORT/DAWN/ |
| Disallow | /db/SUPPORT/DAWSON/ |
| Disallow | /db/SUPPORT/ET/ |
| Disallow | /db/SUPPORT/JAGGED/ |
| Disallow | /db/SUPPORT/SHOP/ |
| Disallow | /db/ARCHIVE/ |
| Disallow | /db/INTERACTIVE/ |
| Disallow | /db/NATIONAL/ |
| Disallow | /db/photos/ |
| Disallow | /greatestallrounder/ |
| Disallow | /icc_cricket_worldcup2011/ |
| Disallow | /radio/ |
| Disallow | /games/content/site/games/ |
| Disallow | /hsbcview/ |
| Disallow | /hsbcviews/ |
| Disallow | /internal_applications/ |
| Disallow | /series/india-tour-of-south-africa-2013-14-648627/ |
| Disallow | /audio/ |
| Disallow | /video/ |
| Disallow | /barbados/ |
| Disallow | /*?cmp |
| Disallow | /*?addata |
| Disallow | /*?wrappertype=print |