sibeliusforum.com
robots.txt

Robots Exclusion Standard data for sibeliusforum.com

Resource Scan

Scan Details

Site Domain sibeliusforum.com
Base Domain sibeliusforum.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-30T17:19:42+00:00
Next Scan 2026-03-30T17:19:42+00:00

Last Successful Scan

Scanned2025-06-04T06:51:26+00:00
URL https://sibeliusforum.com/robots.txt
Domain IPs 216.92.28.37
Response IP 216.92.28.37
Found Yes
Hash 0cd2695356e02b6864db796a01f68a056018b0b332356410d0fe9e4bd2d86a07
SimHash 656ceb22c7f1

Groups

*

Product Comment
* directed to all spiders, not just Scooter
Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 2

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /