statserver.cricket.org
robots.txt

Robots Exclusion Standard data for statserver.cricket.org

Resource Scan

Scan Details

Site Domain statserver.cricket.org
Base Domain cricket.org
Scan Status Ok
Last Scan2024-05-12T13:45:34+00:00
Next Scan 2024-06-11T13:45:34+00:00

Last Scan

Scanned2024-05-12T13:45:34+00:00
URL http://statserver.cricket.org/robots.txt
Redirect https://stats.espncricinfo.com/robots.txt
Redirect Domain stats.espncricinfo.com
Redirect Base espncricinfo.com
Domain IPs 18.141.95.101, 52.76.210.190
Redirect IPs 23.215.7.11, 23.215.7.29, 2600:1413:b000:1c::17d1:2ec8, 2600:1413:b000:1c::17d1:2ed3
Response IP 23.59.168.129
Found Yes
Hash 98445dbe28d2b0620da2be3ded1d92935026b667815e048bf2e4baed11f75d79
SimHash e4599a64c155

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /*wrappertype%3Dprint
Disallow /*template%3Dresults
Disallow /error
Disallow /fragments/
Disallow /country-fragment/
Disallow /country-fragment2/

Other Records

Field Value
crawl-delay 15