Log In Sign Up

rolex.com
robots.txt

Robots Exclusion Standard data for rolex.com

Resource Scan

Scan Details

Site Domain rolex.com
Base Domain rolex.com
Scan Status Ok
Last Scan2024-09-15T12:54:55+00:00
Next Scan 2024-09-29T12:54:55+00:00

Last Scan

Scanned2024-09-15T12:54:55+00:00
URL https://rolex.com/robots.txt
Redirect https://www.rolex.com/robots.txt
Redirect Domain www.rolex.com
Redirect Base rolex.com
Domain IPs 40.67.195.247
Redirect IPs 118.215.82.101, 2600:1413:b000:384::2ee1, 2600:1413:b000:397::2ee1
Response IP 104.69.45.199
Found Yes
Hash 2ee8f0a9fbf50da84f9ffc55b55da496f7ff925ba0ffe880dd3c6397f0923a74
SimHash 2969dc06c83d

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow */about-rolex/sustainable-development/file-a-report
Disallow */en-us/about-rolex/sustainable-development/file-a-report
Disallow /*/wishlist
Disallow /wishlist/*
Disallow /*/wishlist/*
Disallow /wishlist
Disallow /content/rolex/
Disallow /legal-notices/*

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Disallow /de*
Disallow /es*
Disallow /fr*
Disallow /it*
Disallow /pt_br*
Disallow /ru*
Disallow /ar*
Disallow /fa*
Disallow /tr*
Disallow /nl*
Disallow /vi*
Disallow /hi*
Disallow /pl*
Disallow /ko*
Disallow /ja*
Disallow /ms*
Disallow /he*

haosouspider

Rule Path
Disallow /de*
Disallow /es*
Disallow /fr*
Disallow /it*
Disallow /pt_br*
Disallow /ru*
Disallow /ar*
Disallow /fa*
Disallow /tr*
Disallow /nl*
Disallow /vi*
Disallow /pl*
Disallow /hi*
Disallow /ko*
Disallow /ja*
Disallow /ms*
Disallow /he*
Back to top

Other Records

Field Value
sitemap https://www.rolex.com/sitemap.xml
Back to top

Warnings

  • 1 invalid line.
Back to top