Log In Sign Up

omegawatches.co.kr
robots.txt

Robots Exclusion Standard data for omegawatches.co.kr

Resource Scan

Scan Details

Site Domain omegawatches.co.kr
Base Domain omegawatches.co.kr
Scan Status Ok
Last Scan2024-06-23T22:44:15+00:00
Next Scan 2024-07-23T22:44:15+00:00

Last Scan

Scanned2024-06-23T22:44:15+00:00
URL https://www.omegawatches.co.kr/robots.txt
Domain IPs 184.28.235.49, 184.28.235.64, 2600:1417:3f::b81c:eb53, 2600:1417:3f::b81c:eb69
Response IP 23.52.171.59
Found Yes
Hash 3e7a30fcb33acf61f663e020814a6a1a419c4dce106c34d0bf5355b05d7d9a13
SimHash 6025cf2a60b4

Groups

*

Rule Path
Allow /

deepcrawl

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot/4.0

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /
Disallow /*?ab=*
Disallow /*?tmod=*
Disallow /*wishlist/
Disallow /*catalog/product_compare/
Disallow /*checkout/cart
Disallow /*customer/account
Disallow /*contactstore/
Disallow /22258000
Allow /*?zoom=6
Disallow /*?zoom=*
Disallow /*?lat=*
Disallow /*?lng=*
Allow /*en-us/store?countryCode=US
Disallow /*en-us/store?countryCode=*
Allow /*en-gb/store?countryCode=UK
Disallow /*en-gb/store?countryCode=*
Disallow /*?search=*
Disallow /*?price=*
Disallow /*?v_*
Disallow /*?amp*
Disallow /*?watch_*
Disallow /*?watchHubRef*
Disallow /*watchHubRef*
Disallow /*watchfinder?*
Disallow /*?jewellery_*
Disallow /*jewellery_*
Disallow /*?accessory_*
Disallow /*accessory_*
Disallow /*?leather_*
Disallow /*leather_*
Disallow /*?product_*
Disallow /*product_*
Disallow /*?parent_*
Disallow /*parent_*
Disallow /*?strap_*
Disallow /*strap_*
Disallow /*.pdf$
Disallow /*cron.php
Disallow /*localization/ajax/country*
Disallow /*messageall*
Disallow /*?%7B%7D*
Disallow /*load/?_*

baiduspider

Rule Path
Disallow /de*
Disallow /en*
Disallow /es*
Disallow /fr*
Disallow /it*
Disallow /ru*
Disallow /it*
Disallow /pt*
Disallow /ja*
Disallow /ko*
Disallow /*?search=*
Disallow /*?price=*
Disallow /*?v_*
Disallow /*?amp*
Disallow /*?watch_*
Disallow /*?watchHubRef*
Disallow /*watchHubRef*
Disallow /*watchfinder?*
Disallow /*?jewellery_*
Disallow /*jewellery_*
Disallow /*?accessory_*
Disallow /*accessory_*
Disallow /*?leather_*
Disallow /*leather_*
Disallow /*?product_*
Disallow /*product_*
Disallow /*?parent_*
Disallow /*parent_*
Disallow /*.pdf$
Disallow /*cron.php
Disallow /*localization/ajax/country*
Disallow /*messageall*
Disallow /*?%7B%7D*
Disallow /*load/?_*

Other Records

Field Value
crawl-delay 2
Back to top

Comments

  • Crawling directives for AllBot
  • Crawling directives for Deepcrawl
  • Crawling directives for AhrefsBot
  • Crawling directives for dotbot
  • Crawling directives for MJ12bot
  • Crawling directives for PetalBot
  • Crawling directives for SeznamBot
  • Crawling directives for MojeekBot/0.11
  • A/B testing
  • Paths and folders
  • All store specifications
  • Store specifications en-us
  • Store specifications en-gb
  • Filters
  • Files
  • Crawling directives for BaiduBot
  • Other Languages
  • Filters
  • Files
Back to top