dehistoriske.no
robots.txt

Robots Exclusion Standard data for dehistoriske.no

Resource Scan

Scan Details

Site Domain dehistoriske.no
Base Domain dehistoriske.no
Scan Status Ok
Last Scan2025-09-21T23:35:35+00:00
Next Scan 2025-10-21T23:35:35+00:00

Last Scan

Scanned2025-09-21T23:35:35+00:00
URL https://dehistoriske.no/robots.txt
Redirect https://www.dehistoriske.no/robots.txt
Redirect Domain www.dehistoriske.no
Redirect Base dehistoriske.no
Domain IPs 104.21.55.68, 172.67.170.157, 2606:4700:3033::ac43:aa9d, 2606:4700:3035::6815:3744
Redirect IPs 104.21.55.68, 172.67.170.157, 2606:4700:3033::ac43:aa9d, 2606:4700:3035::6815:3744
Response IP 172.67.170.157
Found Yes
Hash 28d3d657a5af45b48592da64daa98c8bf06bd598c9d6cb95b88314ceb0616238
SimHash 810a39474f34

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /hidden/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /usercontrols/
Disallow /xslt/
Disallow /episerver/
Disallow /secure/
Disallow *.pdf

googlebot

Rule Path
Allow .js
Allow .css

Other Records

Field Value
sitemap https://www.dehistoriske.no/sitemap.xml

Comments

  • robots.txt for production