Log In Sign Up

nme.no
robots.txt

Robots Exclusion Standard data for nme.no

Resource Scan

Scan Details

Site Domain nme.no
Base Domain nme.no
Scan Status Ok
Last Scan2026-01-25T23:48:31+00:00
Next Scan 2026-02-24T23:48:31+00:00

Last Scan

Scanned2026-01-25T23:48:31+00:00
URL https://nme.no/robots.txt
Domain IPs 2a02:4780:c:27ca::1, 62.72.32.63
Response IP 62.72.32.63
Found Yes
Hash 501ee75724efc158991079971d63b726ed47ce68e32f630e00fd1c632ca25a56
SimHash 616458c4e092

Groups

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.nme.no/sitemap_index.xml
Back to top

Comments

  • OpenAI crawler rate limit - once per 3 minutes
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top