cbsemeterials.com
robots.txt

Robots Exclusion Standard data for cbsemeterials.com

Resource Scan

Scan Details

Site Domain cbsemeterials.com
Base Domain cbsemeterials.com
Scan Status Ok
Last Scan2025-06-14T02:11:32+00:00
Next Scan 2025-06-21T02:11:32+00:00

Last Scan

Scanned2025-06-14T02:11:32+00:00
URL https://cbsemeterials.com/robots.txt
Redirect https://www.cbsemeterials.com/robots.txt
Redirect Domain www.cbsemeterials.com
Redirect Base cbsemeterials.com
Domain IPs 104.21.41.10, 172.67.158.214, 2606:4700:3031::6815:290a, 2606:4700:3035::ac43:9ed6
Redirect IPs 104.21.41.10, 172.67.158.214, 2606:4700:3031::6815:290a, 2606:4700:3035::ac43:9ed6
Response IP 104.21.41.10
Found Yes
Hash c4237eb936d0d1ae48a6631ebf2b368b3278ccd50b6624251eb599d3cf38dcfe
SimHash 6d5d5545cf93

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.cbsemeterials.com/sitemap_index.xml