borgerkraft.no
robots.txt

Robots Exclusion Standard data for borgerkraft.no

Resource Scan

Scan Details

Site Domain borgerkraft.no
Base Domain borgerkraft.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-22T19:03:33+00:00
Next Scan 2025-08-20T19:03:33+00:00

Last Successful Scan

Scanned2024-12-31T18:52:37+00:00
URL https://borgerkraft.no/robots.txt
Domain IPs 104.21.90.252, 172.67.206.100, 2606:4700:3030::6815:5afc, 2606:4700:3032::ac43:ce64
Response IP 104.21.90.252
Found Yes
Hash 09b0a24123f5d183dae0eccd58aee4588d6f5535159586c27966e9f93f91adde
SimHash 1c61a11ad7f2

Groups

*

Rule Path
Disallow /profiles/
Disallow /search

Comments

  • the following adds a rule for all bots to not index any page that contains a profile or search