Log In Sign Up

omegawatches.com
robots.txt

Robots Exclusion Standard data for omegawatches.com

Resource Scan

Scan Details

Site Domain omegawatches.com
Base Domain omegawatches.com
Scan Status Ok
Last Scan2024-06-01T16:30:37+00:00
Next Scan 2024-07-01T16:30:37+00:00

Last Scan

Scanned2024-06-01T16:30:37+00:00
URL https://omegawatches.com/robots.txt
Redirect https://www.omegawatches.com/robots.txt
Redirect Domain www.omegawatches.com
Redirect Base omegawatches.com
Domain IPs 40.115.10.30
Redirect IPs 23.52.171.59, 23.59.168.163, 2600:1413:b000:1d::17d1:2e88, 2600:1413:b000:1d::17d1:2e8c
Response IP 23.59.168.163
Found Yes
Hash 3e7a30fcb33acf61f663e020814a6a1a419c4dce106c34d0bf5355b05d7d9a13
SimHash 6025cf2a60b4

Groups

*

Rule Path
Allow /

deepcrawl

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot/4.0

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /
Disallow /*?ab=*
Disallow /*?tmod=*
Disallow /*wishlist/
Disallow /*catalog/product_compare/
Disallow /*checkout/cart
Disallow /*customer/account
Disallow /*contactstore/
Disallow /22258000
Allow /*?zoom=6
Disallow /*?zoom=*
Disallow /*?lat=*
Disallow /*?lng=*
Allow /*en-us/store?countryCode=US
Disallow /*en-us/store?countryCode=*
Allow /*en-gb/store?countryCode=UK
Disallow /*en-gb/store?countryCode=*
Disallow /*?search=*
Disallow /*?price=*
Disallow /*?v_*
Disallow /*?amp*
Disallow /*?watch_*
Disallow /*?watchHubRef*
Disallow /*watchHubRef*
Disallow /*watchfinder?*
Disallow /*?jewellery_*
Disallow /*jewellery_*
Disallow /*?accessory_*
Disallow /*accessory_*
Disallow /*?leather_*
Disallow /*leather_*
Disallow /*?product_*
Disallow /*product_*
Disallow /*?parent_*
Disallow /*parent_*
Disallow /*?strap_*
Disallow /*strap_*
Disallow /*.pdf$
Disallow /*cron.php
Disallow /*localization/ajax/country*
Disallow /*messageall*
Disallow /*?%7B%7D*
Disallow /*load/?_*

baiduspider

Rule Path
Disallow /de*
Disallow /en*
Disallow /es*
Disallow /fr*
Disallow /it*
Disallow /ru*
Disallow /it*
Disallow /pt*
Disallow /ja*
Disallow /ko*
Disallow /*?search=*
Disallow /*?price=*
Disallow /*?v_*
Disallow /*?amp*
Disallow /*?watch_*
Disallow /*?watchHubRef*
Disallow /*watchHubRef*
Disallow /*watchfinder?*
Disallow /*?jewellery_*
Disallow /*jewellery_*
Disallow /*?accessory_*
Disallow /*accessory_*
Disallow /*?leather_*
Disallow /*leather_*
Disallow /*?product_*
Disallow /*product_*
Disallow /*?parent_*
Disallow /*parent_*
Disallow /*.pdf$
Disallow /*cron.php
Disallow /*localization/ajax/country*
Disallow /*messageall*
Disallow /*?%7B%7D*
Disallow /*load/?_*

Other Records

Field Value
crawl-delay 2
Back to top

Comments

  • Crawling directives for AllBot
  • Crawling directives for Deepcrawl
  • Crawling directives for AhrefsBot
  • Crawling directives for dotbot
  • Crawling directives for MJ12bot
  • Crawling directives for PetalBot
  • Crawling directives for SeznamBot
  • Crawling directives for MojeekBot/0.11
  • A/B testing
  • Paths and folders
  • All store specifications
  • Store specifications en-us
  • Store specifications en-gb
  • Filters
  • Files
  • Crawling directives for BaiduBot
  • Other Languages
  • Filters
  • Files
Back to top