instafysiologen.no
robots.txt

Robots Exclusion Standard data for instafysiologen.no

Resource Scan

Scan Details

Site Domain instafysiologen.no
Base Domain instafysiologen.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-28T01:17:26+00:00
Next Scan 2025-10-26T01:17:26+00:00

Last Successful Scan

Scanned2024-09-08T06:59:10+00:00
URL https://instafysiologen.no/robots.txt
Domain IPs 3.125.172.46, 3.73.27.108
Response IP 3.125.172.46
Found Yes
Hash f4d1f5d857cdb1b31238c5e2e7fd05cfd068cc8f0449a0da95dbf0c9630d1c69
SimHash 6d54d8b08323

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://instafysiologen.no/sitemap.xml