watchshop.com
robots.txt
Robots Exclusion Standard data for watchshop.com
Resource Scan
Scan Details
Site Domain | watchshop.com |
Base Domain | watchshop.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-09T07:39:36+00:00 |
Next Scan | 2024-11-07T07:39:36+00:00 |
Last Successful Scan
Scanned | 2024-03-20T07:31:52+00:00 |
URL | https://watchshop.com/robots.txt |
Redirect | https://www.watchshop.com/robots.txt |
Redirect Domain | www.watchshop.com |
Redirect Base | watchshop.com |
Domain IPs | 34.252.217.212, 54.194.158.109, 54.72.167.205 |
Redirect IPs | 34.252.217.212, 54.194.158.109, 54.72.167.205 |
Response IP | 54.72.167.205 |
Found | Yes |
Hash | 3e3f455ffb201075f3ebd08ecd27dcc25f6e27caece518d85e65ff426fe3d476 |
SimHash | 2211c921cfbd |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*priceFrom%3D* |
Disallow | /*priceTo%3D* |
Disallow | *?orderBy=* |
Disallow | *?viewAs=* |
Disallow | *search?* |
Disallow | /watchnews/*year%3D* |
Disallow | /ajax/* |
Disallow | *?gender* |
Disallow | *?rcproduct=* |
Disallow | *?brand* |
Disallow | *?giftset* |
Disallow | *?producttype* |
Disallow | *?strap* |
Disallow | *?qv=true* |
Disallow | *?source=froogle* |
Disallow | *?features=* |
Disallow | *?colour%5B* |
Disallow | *?caseColour%5B* |
Disallow | *?onsitesearch=* |
Disallow | *?st=* |
Disallow | *?strap=* |
Disallow | *%3Dcitizen* |
Disallow | *show%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.watchshop.com/sitemap.xml |
Comments