softstarshoes.com
robots.txt

Robots Exclusion Standard data for softstarshoes.com

Resource Scan

Scan Details

Site Domain softstarshoes.com
Base Domain softstarshoes.com
Scan Status Ok
Last Scan2025-09-17T05:35:34+00:00
Next Scan 2025-10-17T05:35:34+00:00

Last Scan

Scanned2025-09-17T05:35:34+00:00
URL https://softstarshoes.com/robots.txt
Redirect https://www.softstarshoes.com/robots.txt
Redirect Domain www.softstarshoes.com
Redirect Base softstarshoes.com
Domain IPs 104.26.2.134, 104.26.3.134, 172.67.75.87, 2606:4700:20::681a:286, 2606:4700:20::681a:386, 2606:4700:20::ac43:4b57
Redirect IPs 104.26.2.134, 104.26.3.134, 172.67.75.87, 2606:4700:20::681a:286, 2606:4700:20::681a:386, 2606:4700:20::ac43:4b57
Response IP 172.67.75.87
Found Yes
Hash 1f1699128c20c1d03256a32f3610542953b07acee96d2d41ea6d84724a15a6b3
SimHash e32dcbc053d3

Groups

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /catalogsearch/

ahrefsbot

Rule Path
Allow /*.php$
Disallow /clearance

Other Records

Field Value
crawl-delay 30

amazonbot

Rule Path
Disallow /clearance

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.softstarshoes.com/media/google_sitemap_1.xml
sitemap https://www.softstarshoes.com/live-bare-blog/author-sitemap.xml
sitemap https://www.softstarshoes.com/live-bare-blog/category-sitemap.xml
sitemap https://www.softstarshoes.com/live-bare-blog/page-sitemap.xml
sitemap https://www.softstarshoes.com/live-bare-blog/post-sitemap.xml

Warnings

  • 42 invalid lines.