stats.espncricinfo.com
robots.txt

Robots Exclusion Standard data for stats.espncricinfo.com

Resource Scan

Scan Details

Site Domain stats.espncricinfo.com
Base Domain espncricinfo.com
Scan Status Ok
Last Scan2024-09-23T03:12:57+00:00
Next Scan 2024-09-30T03:12:57+00:00

Last Scan

Scanned2024-09-23T03:12:57+00:00
URL https://stats.espncricinfo.com/robots.txt
Domain IPs 184.50.85.131, 184.50.85.162, 2600:1413:b000:1c::17d1:2ed0, 2600:1413:b000:1c::17d1:2edb
Response IP 23.59.168.98
Found Yes
Hash 98445dbe28d2b0620da2be3ded1d92935026b667815e048bf2e4baed11f75d79
SimHash e4599a64c155

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /*wrappertype%3Dprint
Disallow /*template%3Dresults
Disallow /error
Disallow /fragments/
Disallow /country-fragment/
Disallow /country-fragment2/

Other Records

Field Value
crawl-delay 15