vancleefarpels.com
robots.txt
Robots Exclusion Standard data for vancleefarpels.com
Resource Scan
Scan Details
Site Domain | vancleefarpels.com |
Base Domain | vancleefarpels.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-06-30T09:29:47+00:00 |
Next Scan | 2024-09-28T09:29:47+00:00 |
Last Successful Scan
Scanned | 2023-02-13T22:55:53+00:00 |
URL | https://vancleefarpels.com/robots.txt |
Redirect | https://www.vancleefarpels.com/robots.txt |
Redirect Domain | www.vancleefarpels.com |
Redirect Base | vancleefarpels.com |
Domain IPs | 23.52.171.202, 23.59.168.161, 2600:1417:3f::b81c:eb51, 2600:1417:3f::b81c:eb63 |
Redirect IPs | 23.52.171.202, 23.59.168.161, 2600:1413:1::76d6:a767, 2600:1413:1::b832:55eb |
Response IP | 23.52.171.202 |
Found | Yes |
Hash | 0c738e9183c198fabbce36367251dfeebf505efaa4ae01139779b0b1616c4753 |
SimHash | 531495926e1c |
Groups
*
Rule | Path |
---|---|
Disallow | /*_jcr_content* |
Disallow | /*?facet=* |
Disallow | /*.cart.summary.json |
Disallow | /*.print* |
Disallow | /*.productinfo.json |
Disallow | /*.rcq.profile.json |
Disallow | /*.rcq.wishlist.json |
Disallow | /*.rcqcommerce.cart.complete.json |
Disallow | /*.search.json* |
Disallow | /*/addNotebook/* |
Disallow | /*ms-bas* |
Disallow | /*popin%3D* |
Disallow | /*search-result.html?q=* |
Disallow | /*tent/vc* |
Disallow | /*token.json |
Disallow | /*/print/* |
Disallow | /*/catalog-blueprint-template-pages* |
Disallow | /*/checkout* |
Disallow | /*/collections.html |
Disallow | /*/e-boutique.html |
Disallow | /*/e-boutique/category.html |
Disallow | /*/emails.html |
Disallow | /*/errors* |
Disallow | /*/events.html |
Disallow | /*/fragments* |
Disallow | /*/legal.html |
Disallow | /*/Location.html |
Disallow | /*/secure* |
Disallow | /*/store-blueprint-page.html |
Disallow | /*/store-locator-results-page.html?* |
Disallow | /*/wishlist* |
Disallow | /*?srch* |
Disallow | /*?boutiqueId=* |
Disallow | /*?page=* |
Disallow | /*/temp* |
Disallow | /*/search/search.html?* |
Disallow | /*/home.html?* |
Disallow | /*?size=&reference=* |
Allow | /*/secure/contact-us.html$ |
Allow | /*/secure/in-store-appointment.html$ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.vancleefarpels.com/sitemapindex.xml |