defence-force.org
robots.txt

Robots Exclusion Standard data for defence-force.org

Resource Scan

Scan Details

Site Domain defence-force.org
Base Domain defence-force.org
Scan Status Ok
Last Scan2025-09-19T15:59:10+00:00
Next Scan 2025-10-19T15:59:10+00:00

Last Scan

Scanned2025-09-19T15:59:10+00:00
URL https://defence-force.org/robots.txt
Domain IPs 194.63.249.214, 2a01:5b40:0:4a03:0:a9cf:c0da:6eb9
Response IP 194.63.249.214
Found Yes
Hash 0c2d9f8642759bac485bf8167abd72ec69040cad93a36a92e7cb53972f2b594d
SimHash 3650d8f0c931

Groups

*

Rule Path
Allow /
Disallow /download/

Other Records

Field Value
crawl-delay 25

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bspider

Rule Path
Disallow /