florsheim.com
robots.txt

Robots Exclusion Standard data for florsheim.com

Resource Scan

Scan Details

Site Domain florsheim.com
Base Domain florsheim.com
Scan Status Ok
Last Scan2024-11-20T18:31:16+00:00
Next Scan 2024-12-04T18:31:16+00:00

Last Scan

Scanned2024-11-20T18:31:16+00:00
URL https://florsheim.com/robots.txt
Redirect https://www.florsheim.com/robots.txt
Redirect Domain www.florsheim.com
Redirect Base florsheim.com
Domain IPs 139.60.100.41, 74.217.255.84
Redirect IPs 66.150.187.198
Response IP 66.150.187.198
Found Yes
Hash c143d894206fa212bf91196a42a8e1189109e7344449da9bcdfd8bacd3582c94
SimHash 466447524297

Groups

*

Rule Path
Disallow /shop/javax*
Disallow /WEB-INF/
Disallow /shop/xmlhttp*
Disallow /shop/META-INF/INF/
Disallow /feeds/
Disallow /shop/default-landing-page.html
Disallow /shop/styleGridSearch.html?
Disallow /shop/shoppingCart.html
Disallow /shop/customers

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.florsheim.com/SiteMap.xml
sitemap https://www.florsheim.com/ImageSiteMap.xml

Comments

  • Note for all agents
  • Framework required items
  • Disallows entire checkout process