cemnet.com
robots.txt

Robots Exclusion Standard data for cemnet.com

Resource Scan

Scan Details

Site Domain cemnet.com
Base Domain cemnet.com
Scan Status Ok
Last Scan2025-06-18T17:49:55+00:00
Next Scan 2025-07-18T17:49:55+00:00

Last Scan

Scanned2025-06-18T17:49:55+00:00
URL https://cemnet.com/robots.txt
Redirect https://www.cemnet.com/robots.txt
Redirect Domain www.cemnet.com
Redirect Base cemnet.com
Domain IPs 104.26.4.9, 104.26.5.9, 172.67.71.130, 2606:4700:20::681a:409, 2606:4700:20::681a:509, 2606:4700:20::ac43:4782
Redirect IPs 138.199.46.68, 2400:52e0:1500::1272:1
Response IP 138.199.46.65
Found Yes
Hash d95dfffea102330359a472c62e5bcaeeff18bd93f64441937624d5798d73be62
SimHash 0d5cdc414f11

Groups

*

Rule Path
Allow /
Disallow /BotDetectCaptcha.ashx
Disallow /general/subs/subs_cemnet.aspx

blexbot

Rule Path
Disallow /
Disallow /BotDetectCaptcha.ashx
Disallow /general/subs/subs_cemnet.aspx

ltx71

Rule Path
Disallow /
Disallow /BotDetectCaptcha.ashx
Disallow /general/subs/subs_cemnet.aspx

bingbot

Rule Path
Disallow /BotDetectCaptcha.ashx
Disallow /general/subs/subs_cemnet.aspx

Other Records

Field Value
sitemap https://www.cemnet.com/home/sitemap