hviit.no
robots.txt

Robots Exclusion Standard data for hviit.no

Resource Scan

Scan Details

Site Domain hviit.no
Base Domain hviit.no
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-24T18:59:33+00:00
Next Scan 2025-12-23T18:59:33+00:00

Last Successful Scan

Scanned2023-08-12T16:28:11+00:00
URL https://hviit.no/robots.txt
Domain IPs 54.195.240.169
Response IP 54.195.240.169
Found Yes
Hash 7ce9edebe9360297b418ee093f4fdbb4553ff3c905881d34013a0266ac83664d
SimHash e205db8163b3

Groups

*

Rule Path
Allow /
Disallow /kontrollpanel
Disallow /search
Disallow /search_result
Disallow /search_result?*
Disallow /cookie_usage

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5