finanstilsynet.no
robots.txt

Robots Exclusion Standard data for finanstilsynet.no

Resource Scan

Scan Details

Site Domain finanstilsynet.no
Base Domain finanstilsynet.no
Scan Status Ok
Last Scan2025-06-12T17:28:34+00:00
Next Scan 2025-07-12T17:28:34+00:00

Last Scan

Scanned2025-06-12T17:28:34+00:00
URL https://finanstilsynet.no/robots.txt
Redirect https://www.finanstilsynet.no/robots.txt
Redirect Domain www.finanstilsynet.no
Redirect Base finanstilsynet.no
Domain IPs 217.114.94.2, 2a00:1c50:94::2
Redirect IPs 104.18.37.178, 172.64.150.78, 2606:4700:4400::6812:25b2, 2606:4700:4400::ac40:964e
Response IP 172.64.150.78
Found Yes
Hash 54216b86835d852b7a7ed304604522619e0f28bb5be087415afdb15e9867ca6c
SimHash 4b10d854c633

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.finanstilsynet.no/sitemap.xml
sitemap https://www.finanstilsynet.no/en/sitemap.xml