sperry.com
robots.txt
Robots Exclusion Standard data for sperry.com
Resource Scan
Scan Details
Site Domain | sperry.com |
Base Domain | sperry.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T05:05:16+00:00 |
Next Scan | 2024-11-16T05:05:16+00:00 |
Last Successful Scan
Scanned | 2024-07-22T04:33:53+00:00 |
URL | https://sperry.com/robots.txt |
Redirect | https://www.sperry.com/robots.txt |
Redirect Domain | www.sperry.com |
Redirect Base | sperry.com |
Domain IPs | 23.59.168.121, 2600:1413:b000:1b::17d7:70a, 2600:1413:b000:1b::17d7:718 |
Redirect IPs | 23.215.7.10, 23.215.7.24, 2600:1413:b000:1b::17d7:70a, 2600:1413:b000:1b::17d7:718 |
Response IP | 23.52.40.72 |
Found | Yes |
Hash | 1dfa064dee6704a83362420b4676e424c8338997f524826a1051969c6c5c0acd |
SimHash | 6e8015d8a985 |
Groups
*
Rule | Path |
---|---|
Disallow | */undefined/p/undefined |
Disallow | */favourites |
Disallow | */account |
Disallow | */interac |
Disallow | */checkout |
Disallow | */error |
Disallow | /*sort%3D* |
Disallow | /*show%3D* |
Disallow | /*viewAll%3D* |
Disallow | */create-account |
Disallow | */return/confirmation |
Disallow | */app |
Disallow | */crew/associate-sign-up |
Disallow | /*overlay%3Dcrew-sign-in* |
Disallow | */preferences* |
Allow | */assets |
Disallow | /*overlay%3Dauth-type-chooser* |
Disallow | /*overlay%3Dsign-in* |
Disallow | /*overlay%3Dcart* |
Other Records
Field | Value |
---|---|
sitemap | https://www.sperry.com/sitemap.xml |
Comments