Log In Sign Up

strim.no
robots.txt

Robots Exclusion Standard data for strim.no

Resource Scan

Scan Details

Site Domain strim.no
Base Domain strim.no
Scan Status Ok
Last Scan2024-09-20T08:13:41+00:00
Next Scan 2024-10-04T08:13:41+00:00

Last Scan

Scanned2024-09-20T08:13:41+00:00
URL https://strim.no/robots.txt
Redirect https://www.strim.no/robots.txt
Redirect Domain www.strim.no
Redirect Base strim.no
Domain IPs 13.226.2.104, 13.226.2.28, 13.226.2.44, 13.226.2.51
Redirect IPs 54.230.112.101, 54.230.112.116, 54.230.112.72, 54.230.112.89
Response IP 3.164.206.64
Found Yes
Hash 7c393758566f10e2016856e7ba5f8e0d9bc35daf811f7c87960a7a3d182267b9
SimHash 8230d958efd5

Groups

*

Rule Path
Disallow /account
Disallow /min-konto
Disallow /search
Disallow /package/change
Back to top

Other Records

Field Value
sitemap https://www.strim.no/sitemap.xml
Back to top

Comments

  • https://developers.google.com/search/docs/crawling-indexing/robots/intro
  • - "The default assumption is that a user agent can crawl any page or directory not blocked by a disallow rule."
  • I.e. no need to use "Allow"-directives
Back to top