roaf.no
robots.txt

Robots Exclusion Standard data for roaf.no

Resource Scan

Scan Details

Site Domain roaf.no
Base Domain roaf.no
Scan Status Ok
Last Scan2025-09-23T11:41:52+00:00
Next Scan 2025-10-07T11:41:52+00:00

Last Scan

Scanned2025-09-23T11:41:52+00:00
URL https://roaf.no/robots.txt
Domain IPs 195.159.29.139, 2001:840:4245::f8
Response IP 195.159.29.139
Found Yes
Hash aa363b0214ae6d6f5a4e192169df8d0013999f17111b120da45cbe0d8699f778
SimHash 3000cb435711

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /artikkel/
Disallow /infoskjerm/