melk.no
robots.txt

Robots Exclusion Standard data for melk.no

Resource Scan

Scan Details

Site Domain melk.no
Base Domain melk.no
Scan Status Ok
Last Scan2024-10-25T12:13:10+00:00
Next Scan 2024-11-24T12:13:10+00:00

Last Scan

Scanned2024-10-25T12:13:10+00:00
URL https://melk.no/robots.txt
Redirect https://www.melk.no/robots.txt
Redirect Domain www.melk.no
Redirect Base melk.no
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.9, 76.76.21.98
Response IP 76.76.21.9
Found Yes
Hash 6de21db78ae35f9954f9b32e4846f088e58f00f77156c228b20cdeef66e28bd1
SimHash 0800c9026730

Groups

*

Rule Path
Disallow /Test

Comments

  • Allow all crawlers