independentsole.com
robots.txt

Robots Exclusion Standard data for independentsole.com

Resource Scan

Scan Details

Site Domain independentsole.com
Base Domain independentsole.com
Scan Status Ok
Last Scan2024-06-11T13:40:32+00:00
Next Scan 2024-07-11T13:40:32+00:00

Last Scan

Scanned2024-06-11T13:40:32+00:00
URL http://independentsole.com/robots.txt
Redirect http://www.independentsole.com/robots.txt
Redirect Domain www.independentsole.com
Redirect Base independentsole.com
Domain IPs 65.39.205.54
Redirect IPs 198.185.159.176, 198.185.159.177, 198.49.23.176, 198.49.23.177
Response IP 198.185.159.176
Found Yes
Hash e150de1fff61a2fd6a959664bbe5fbbd3bb6936ad5dd6141f3b18b97ebc72439
SimHash 380b62e46cd2

Groups

*

Rule Path
Disallow /display/admin/
Disallow /display/Search
Disallow /display/Login
Disallow /display/RecoverPassword
Disallow /login
Disallow /contributor
Disallow /shoe-reviews/category
Disallow /shoe-reviews/week
Disallow /shoe-reviews/month
Disallow /shoe-reviews/recommend
Disallow /shoe-reviews/author
Disallow /foot-notes/category
Disallow /foot-notes/week
Disallow /foot-notes/month
Disallow /foot-notes/recommend
Disallow /foot-notes/author
Disallow /sb-gicptrjb

Comments

  • Squarespace Standard Robot Exclusion
  • Access is disallowed to functional / filtering URLs