ilovejackdaniels.com
robots.txt

Robots Exclusion Standard data for ilovejackdaniels.com

Resource Scan

Scan Details

Site Domain ilovejackdaniels.com
Base Domain ilovejackdaniels.com
Scan Status Ok
Last Scan2025-05-26T08:35:02+00:00
Next Scan 2025-06-25T08:35:02+00:00

Last Scan

Scanned2025-05-26T08:35:02+00:00
URL http://ilovejackdaniels.com/robots.txt
Redirect https://www.jackdaniels.com/robots.txt
Redirect Domain www.jackdaniels.com
Redirect Base jackdaniels.com
Domain IPs 12.154.101.30
Redirect IPs 23.185.0.4, 2620:12a:8000::4, 2620:12a:8001::4
Response IP 23.185.0.4
Found Yes
Hash fb7daac1eba83a1fd1725c2d7c6948feaa6b717762624c107db99e0464c7b42a
SimHash d11c44f2dd90

Groups

*

Rule Path
Disallow /api/
Disallow /_next/
Disallow /static/
Disallow /404
Disallow /500
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

sogou

Rule Path
Disallow /

Comments

  • Standard crawl directives
  • Disallow known bad bots