spring.org.uk
robots.txt

Robots Exclusion Standard data for spring.org.uk

Resource Scan

Scan Details

Site Domain spring.org.uk
Base Domain spring.org.uk
Scan Status Ok
Last Scan2024-10-30T12:25:05+00:00
Next Scan 2024-11-06T12:25:05+00:00

Last Scan

Scanned2024-10-30T12:25:05+00:00
URL https://spring.org.uk/robots.txt
Domain IPs 207.7.88.118
Response IP 207.7.88.118
Found Yes
Hash 6e365b0712c661d6fc278922aa3542cbd23e16079ebe6e363c597b9fe96e17bd
SimHash 633cdc60e311

Groups

*

Rule Path
Disallow /osgstudy/
Disallow /series/
Disallow /c4p_log/

gptbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5