mweb.com
robots.txt

Robots Exclusion Standard data for mweb.com

Resource Scan

Scan Details

Site Domain mweb.com
Base Domain mweb.com
Scan Status Ok
Last Scan2024-09-21T21:25:32+00:00
Next Scan 2024-10-21T21:25:32+00:00

Last Scan

Scanned2024-09-21T21:25:32+00:00
URL https://mweb.com/robots.txt
Redirect https://www.mweb.co.za/robots.txt
Redirect Domain www.mweb.co.za
Redirect Base mweb.co.za
Domain IPs 102.65.21.236
Redirect IPs 13.33.30.107, 13.33.30.48, 13.33.30.56, 13.33.30.92
Response IP 13.33.30.107
Found Yes
Hash 89ced554933210d95de71733051bdd282561aa40562b7f3ae2411b2f96fb20b2
SimHash e9008c30cbb3

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /*.pdf

Other Records

Field Value
sitemap https://www.mweb.co.za/sitemap_index.xml