footballblog.co.uk
robots.txt

Robots Exclusion Standard data for footballblog.co.uk

Resource Scan

Scan Details

Site Domain footballblog.co.uk
Base Domain footballblog.co.uk
Scan Status Ok
Last Scan2024-11-09T13:21:06+00:00
Next Scan 2024-11-16T13:21:06+00:00

Last Scan

Scanned2024-11-09T13:21:06+00:00
URL https://footballblog.co.uk/robots.txt
Domain IPs 208.80.6.193, 2604:4f00:10:bc16:0:48:150:1
Response IP 208.80.6.193
Found Yes
Hash 38ac243fcea200cf0ce2159195ad8c051425d6160c01ee1432b817eac7680bce
SimHash 6d50dc44c7d3

Groups

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 10