mweb.net
robots.txt

Robots Exclusion Standard data for mweb.net

Resource Scan

Scan Details

Site Domain mweb.net
Base Domain mweb.net
Scan Status Ok
Last Scan2024-05-30T03:24:09+00:00
Next Scan 2024-06-29T03:24:09+00:00

Last Scan

Scanned2024-05-30T03:24:09+00:00
URL https://mweb.net/robots.txt
Redirect https://www.mweb.co.za/robots.txt
Redirect Domain www.mweb.co.za
Redirect Base mweb.co.za
Domain IPs 196.41.128.101
Redirect IPs 108.157.254.110, 108.157.254.115, 108.157.254.54, 108.157.254.97
Response IP 108.157.254.110
Found Yes
Hash 89ced554933210d95de71733051bdd282561aa40562b7f3ae2411b2f96fb20b2
SimHash e9008c30cbb3

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /*.pdf

Other Records

Field Value
sitemap https://www.mweb.co.za/sitemap_index.xml