cmbengine.com
robots.txt

Robots Exclusion Standard data for cmbengine.com

Resource Scan

Scan Details

Site Domain cmbengine.com
Base Domain cmbengine.com
Scan Status Ok
Last Scan2025-09-08T22:35:51+00:00
Next Scan 2025-09-22T22:35:51+00:00

Last Scan

Scanned2025-09-08T22:35:51+00:00
URL https://cmbengine.com/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.36.21
Found Yes
Hash 36c76fde372c311df75a4c9b216bc4d070718b31d8eb3d35cb677c754d6146b6
SimHash 6d4dd4140815

Groups

yandex
mauibot
mauibot (crawler.feedback+wc@gmail.com)
petalbot
mj12bot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /cart
Disallow /cart_checkout
Disallow /payment
Disallow /confirmation
Disallow /user_cms
Disallow /business

*

Rule Path
Disallow /cart
Disallow /cart_checkout
Disallow /payment
Disallow /confirmation
Disallow /user_cms
Disallow /business
Disallow /*?lang=*
Disallow /*%26lang%3D*

Other Records

Field Value
sitemap http://cmbengine.com/sitemap.xml