watchshop.com
robots.txt

Robots Exclusion Standard data for watchshop.com

Resource Scan

Scan Details

Site Domain watchshop.com
Base Domain watchshop.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-09T07:39:36+00:00
Next Scan 2024-11-07T07:39:36+00:00

Last Successful Scan

Scanned2024-03-20T07:31:52+00:00
URL https://watchshop.com/robots.txt
Redirect https://www.watchshop.com/robots.txt
Redirect Domain www.watchshop.com
Redirect Base watchshop.com
Domain IPs 34.252.217.212, 54.194.158.109, 54.72.167.205
Redirect IPs 34.252.217.212, 54.194.158.109, 54.72.167.205
Response IP 54.72.167.205
Found Yes
Hash 3e3f455ffb201075f3ebd08ecd27dcc25f6e27caece518d85e65ff426fe3d476
SimHash 2211c921cfbd

Groups

*

Rule Path
Allow /
Disallow /*priceFrom%3D*
Disallow /*priceTo%3D*
Disallow *?orderBy=*
Disallow *?viewAs=*
Disallow *search?*
Disallow /watchnews/*year%3D*
Disallow /ajax/*
Disallow *?gender*
Disallow *?rcproduct=*
Disallow *?brand*
Disallow *?giftset*
Disallow *?producttype*
Disallow *?strap*
Disallow *?qv=true*
Disallow *?source=froogle*
Disallow *?features=*
Disallow *?colour%5B*
Disallow *?caseColour%5B*
Disallow *?onsitesearch=*
Disallow *?st=*
Disallow *?strap=*
Disallow *%3Dcitizen*
Disallow *show%3D*

Other Records

Field Value
crawl-delay 5

etaospider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pricebot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.watchshop.com/sitemap.xml

Comments

  • chinese search bot
  • User-agent: AhrefsBot
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /
  • seo bots that do not benefit us
  • bot for amfibi.com