archives.mtexpress.com
robots.txt

Robots Exclusion Standard data for archives.mtexpress.com

Resource Scan

Scan Details

Site Domain archives.mtexpress.com
Base Domain mtexpress.com
Scan Status Ok
Last Scan2025-07-30T20:17:35+00:00
Next Scan 2025-08-29T20:17:35+00:00

Last Scan

Scanned2025-07-30T20:17:35+00:00
URL https://archives.mtexpress.com/robots.txt
Domain IPs 160.153.0.18
Response IP 160.153.0.18
Found Yes
Hash aa2e12c381cd415d785611e41305e2b8f1077790a88372e3256e2a1d169ce141
SimHash 4c55c064c353

Groups

*

Rule Path
Disallow /cgi-bin/

zbot

Rule Path
Disallow /