app.katolsk.no
robots.txt

Robots Exclusion Standard data for app.katolsk.no

Resource Scan

Scan Details

Site Domain app.katolsk.no
Base Domain katolsk.no
Scan Status Ok
Last Scan2025-06-25T04:55:47+00:00
Next Scan 2025-07-25T04:55:47+00:00

Last Scan

Scanned2025-06-25T04:55:47+00:00
URL https://app.katolsk.no/robots.txt
Domain IPs 2a02:270:2019::24, 77.88.108.24
Response IP 77.88.108.24
Found Yes
Hash 0719a7a5fe8224d7d6751b240ed07a76e6fcf91cd1de65472e6614ee3c0143f7
SimHash bc18de82e533

Groups

direct hit grabber
mozilla/4.06 [en] (direct hit grabber)

Rule Path
Disallow /

slurp

Rule Path
Disallow /

scooter

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Comments

  • Robots.txt file
  • Let all other crawlers do their stuff unhindered