tommybahama.com
robots.txt

Robots Exclusion Standard data for tommybahama.com

Resource Scan

Scan Details

Site Domain tommybahama.com
Base Domain tommybahama.com
Scan Status Ok
Last Scan2024-06-01T19:33:06+00:00
Next Scan 2024-07-01T19:33:06+00:00

Last Scan

Scanned2024-06-01T19:33:06+00:00
URL https://tommybahama.com/robots.txt
Redirect https://www.tommybahama.com/robots.txt
Redirect Domain www.tommybahama.com
Redirect Base tommybahama.com
Domain IPs 23.203.78.91
Redirect IPs 23.39.8.211
Response IP 23.39.8.211
Found Yes
Hash 2e81f2f834ee2555670d87bd4043ca8373bf3032cad0b013cd11c3788e5857b1
SimHash 079218104ea3

Groups

googlebot

Rule Path
Disallow */*/search?q=

Other Records

Field Value
crawl-delay 10

adidxbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

wbot

Rule Path
Disallow /

litefinder

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

funwebproducts

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow */*/search?q=

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.tommybahama.com/en/sitemap.xml

Comments

  • robots.txt for http://www.tommybahama.com/ 09/19/2017