faq.bodi.com
robots.txt

Robots Exclusion Standard data for faq.bodi.com

Resource Scan

Scan Details

Site Domain faq.bodi.com
Base Domain bodi.com
Scan Status Ok
Last Scan2025-06-29T01:24:52+00:00
Next Scan 2025-07-29T01:24:52+00:00

Last Scan

Scanned2025-06-29T01:24:52+00:00
URL https://faq.bodi.com/robots.txt
Domain IPs 76.76.21.164, 76.76.21.93
Response IP 66.33.60.66
Found Yes
Hash 6e28f52baf91e489f52c643ea1a5160749e55079ad15d7acb28360abb355a3af
SimHash 2f4ada00c407

Groups

googlebot

Product Comment
googlebot Google # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

msnbot

Product Comment
msnbot MSN # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

slurp

Product Comment
slurp Yahoo! # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

teoma

Product Comment
teoma Ask.com # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

bingbot

Product Comment
bingbot Bing # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://faq.bodi.com/sitemap.xml ADDED BY HMS