beebithk.com
robots.txt

Robots Exclusion Standard data for beebithk.com

Resource Scan

Scan Details

Site Domain beebithk.com
Base Domain beebithk.com
Scan Status Ok
Last Scan2025-08-30T16:12:53+00:00
Next Scan 2025-09-13T16:12:53+00:00

Last Scan

Scanned2025-08-30T16:12:53+00:00
URL https://beebithk.com/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.34.21
Found Yes
Hash 5886152bfbb4fbe6c79b3eec892246ad3d3b1aa35dc316427a131d1b3cf9d30c
SimHash 6d4dd4170855

Groups

yandex
mauibot
mauibot (crawler.feedback+wc@gmail.com)
petalbot
mj12bot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /cart
Disallow /cart_checkout
Disallow /payment
Disallow /confirmation
Disallow /user_cms
Disallow /business

*

Rule Path
Disallow /cart
Disallow /cart_checkout
Disallow /payment
Disallow /confirmation
Disallow /user_cms
Disallow /business
Disallow /*?lang=*
Disallow /*%26lang%3D*

Other Records

Field Value
sitemap http://beebithk.com/sitemap.xml