jernia.no
robots.txt

Robots Exclusion Standard data for jernia.no

Resource Scan

Scan Details

Site Domain jernia.no
Base Domain jernia.no
Scan Status Ok
Last Scan2025-05-10T10:00:33+00:00
Next Scan 2025-06-09T10:00:33+00:00

Last Scan

Scanned2025-05-10T10:00:33+00:00
URL https://jernia.no/robots.txt
Redirect https://www.jernia.no/robots.txt
Redirect Domain www.jernia.no
Redirect Base jernia.no
Domain IPs 76.76.21.21
Redirect IPs 216.198.79.1, 64.29.17.1
Response IP 64.29.17.65
Found Yes
Hash b6884ed0c6f8afa2faa3c614ba30f17c0ef81cab4ea42eab744e0920847f0e5a
SimHash 62704f4d6fe7

Groups

*

Rule Path
Disallow /*/c/*?*=*
Disallow /merker/*?q=*
Disallow /search
Disallow /search?*=*
Disallow /*?queryID=*
Disallow /*%26queryID%3D*
Disallow /*?order=*
Disallow /*%26order%3D*
Disallow /*?post_type=*
Disallow /*%26post_type%3D*
Disallow /wishlist/*
Disallow /cart
Disallow /checkout
Disallow /my-account
Disallow /my-company

Other Records

Field Value Comment
crawl-delay 10 10 seconds between page requests

Other Records

Field Value
sitemap https://www.jernia.no/sitemap.xml

Comments

  • For all robots
  • Allow search crawlers to discover the sitemap

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.