msmw.com
robots.txt

Robots Exclusion Standard data for msmw.com

Resource Scan

Scan Details

Site Domain msmw.com
Base Domain msmw.com
Scan Status Ok
Last Scan2025-10-26T05:39:26+00:00
Next Scan 2025-11-25T05:39:26+00:00

Last Scan

Scanned2025-10-26T05:39:26+00:00
URL http://msmw.com/robots.txt
Redirect http://www.msmw.com/robots.txt
Redirect Domain www.msmw.com
Redirect Base msmw.com
Domain IPs 199.34.228.50
Redirect IPs 199.34.228.50
Response IP 199.34.228.50
Found Yes
Hash f07ac624f750807c7b78bd67a0f8c82fa945f702c84d07b837145bb787a5faa0
SimHash 2854dc766793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.msmw.com/sitemap.xml