vancleefarpels.com
robots.txt
Robots Exclusion Standard data for vancleefarpels.com
Resource Scan
Scan Details
| Site Domain | vancleefarpels.com |
| Base Domain | vancleefarpels.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-04-01T09:29:35+00:00 |
| Next Scan | 2024-06-30T09:29:35+00:00 |
Last Successful Scan
| Scanned | 2023-02-13T22:55:53+00:00 |
| URL | https://vancleefarpels.com/robots.txt |
| Redirect | https://www.vancleefarpels.com/robots.txt |
| Redirect Domain | www.vancleefarpels.com |
| Redirect Base | vancleefarpels.com |
| Domain IPs | 23.52.171.202, 23.59.168.161, 2600:1417:3f::b81c:eb51, 2600:1417:3f::b81c:eb63 |
| Redirect IPs | 23.52.171.202, 23.59.168.161, 2600:1413:1::76d6:a767, 2600:1413:1::b832:55eb |
| Response IP | 23.52.171.202 |
| Found | Yes |
| Hash | 0c738e9183c198fabbce36367251dfeebf505efaa4ae01139779b0b1616c4753 |
| SimHash | 531495926e1c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*_jcr_content* |
| Disallow | /*?facet=* |
| Disallow | /*.cart.summary.json |
| Disallow | /*.print* |
| Disallow | /*.productinfo.json |
| Disallow | /*.rcq.profile.json |
| Disallow | /*.rcq.wishlist.json |
| Disallow | /*.rcqcommerce.cart.complete.json |
| Disallow | /*.search.json* |
| Disallow | /*/addNotebook/* |
| Disallow | /*ms-bas* |
| Disallow | /*popin%3D* |
| Disallow | /*search-result.html?q=* |
| Disallow | /*tent/vc* |
| Disallow | /*token.json |
| Disallow | /*/print/* |
| Disallow | /*/catalog-blueprint-template-pages* |
| Disallow | /*/checkout* |
| Disallow | /*/collections.html |
| Disallow | /*/e-boutique.html |
| Disallow | /*/e-boutique/category.html |
| Disallow | /*/emails.html |
| Disallow | /*/errors* |
| Disallow | /*/events.html |
| Disallow | /*/fragments* |
| Disallow | /*/legal.html |
| Disallow | /*/Location.html |
| Disallow | /*/secure* |
| Disallow | /*/store-blueprint-page.html |
| Disallow | /*/store-locator-results-page.html?* |
| Disallow | /*/wishlist* |
| Disallow | /*?srch* |
| Disallow | /*?boutiqueId=* |
| Disallow | /*?page=* |
| Disallow | /*/temp* |
| Disallow | /*/search/search.html?* |
| Disallow | /*/home.html?* |
| Disallow | /*?size=&reference=* |
| Allow | /*/secure/contact-us.html$ |
| Allow | /*/secure/in-store-appointment.html$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vancleefarpels.com/sitemapindex.xml |