mweb.co.za
robots.txt

Robots Exclusion Standard data for mweb.co.za

Resource Scan

Scan Details

Site Domain mweb.co.za
Base Domain mweb.co.za
Scan Status Ok
Last Scan2024-04-19T13:56:00+00:00
Next Scan 2024-05-19T13:56:00+00:00

Last Scan

Scanned2024-04-19T13:56:00+00:00
URL https://mweb.co.za/robots.txt
Redirect https://www.mweb.co.za/robots.txt
Redirect Domain www.mweb.co.za
Redirect Base mweb.co.za
Domain IPs 196.41.128.101
Redirect IPs 13.224.163.123, 13.224.163.24, 13.224.163.70, 13.224.163.81
Response IP 108.157.254.110
Found Yes
Hash 89ced554933210d95de71733051bdd282561aa40562b7f3ae2411b2f96fb20b2
SimHash e9008c30cbb3

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /*.pdf

Other Records

Field Value
sitemap https://www.mweb.co.za/sitemap_index.xml