arctic-race-of-norway.com
robots.txt

Robots Exclusion Standard data for arctic-race-of-norway.com

Resource Scan

Scan Details

Site Domain arctic-race-of-norway.com
Base Domain arctic-race-of-norway.com
Scan Status Ok
Last Scan2024-05-25T20:30:05+00:00
Next Scan 2024-06-01T20:30:05+00:00

Last Scan

Scanned2024-05-25T20:30:05+00:00
URL https://arctic-race-of-norway.com/robots.txt
Redirect https://www.arctic-race-of-norway.com/robots.txt
Redirect Domain www.arctic-race-of-norway.com
Redirect Base arctic-race-of-norway.com
Domain IPs 35.241.3.120
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash 1be7c7ae920d052735dcc8ee38a811d067376e8deb560747b772f7adb0c62b86
SimHash 54016d640953

Groups

*

Rule Path
Disallow /admin
Disallow /sonatadmin
Disallow /api
Disallow /graphql
Disallow /login
Disallow /*/ajax
Disallow /*/block
Disallow /*/login
Disallow /*/sitemap

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449