freak.no
robots.txt

Robots Exclusion Standard data for freak.no

Resource Scan

Scan Details

Site Domain freak.no
Base Domain freak.no
Scan Status Ok
Last Scan2025-10-02T11:02:11+00:00
Next Scan 2025-11-01T11:02:11+00:00

Last Scan

Scanned2025-10-02T11:02:11+00:00
URL https://freak.no/robots.txt
Domain IPs 104.21.90.181, 172.67.203.207, 2606:4700:3031::6815:5ab5, 2606:4700:3032::ac43:cbcf
Response IP 172.67.203.207
Found Yes
Hash 0248ce9c4aaca836c9b17a5ff14cb337dbfc446e30e3e6919bcb527be4a2612d
SimHash 903c95407e51

Groups

newspointbot

Rule Path
Disallow /

netsprint

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

brandverity

Rule Path
Disallow /