dsm.co.za
robots.txt
Robots Exclusion Standard data for dsm.co.za
Resource Scan
Scan Details
| Site Domain | dsm.co.za |
| Base Domain | dsm.co.za |
| Scan Status | Ok |
| Last Scan | 2024-04-25T03:57:29+00:00 |
| Next Scan | 2024-05-25T03:57:29+00:00 |
Last Scan
| Scanned | 2024-04-25T03:57:29+00:00 |
| URL | http://dsm.co.za/robots.txt |
| Domain IPs | 41.76.215.25 |
| Response IP | 41.76.215.25 |
| Found | Yes |
| Hash | e733ce962dd3479e903b12e575c5444530c795f2c6275828d39aa46464eb4b36 |
| SimHash | 0000f8ca5590 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /admin/ |
| Disallow | /App/ |
| Disallow | /aspnet_client/ |
| Disallow | /Banners/ |
| Disallow | /bin/ |
| Disallow | /Classes/ |
| Disallow | /Clipart/ |
| Disallow | /database/ |
| Disallow | /Flash/ |
| Disallow | /Flash_Local/ |
| Disallow | /GPRS/ |
| Disallow | /Headings/ |
| Disallow | /Myportal/ |
| Disallow | /New/ |
| Disallow | /NewFolder1/ |
| Disallow | /siteportal/ |
| Disallow | /Temp/ |
| Disallow | /TempUploads/ |
| Disallow | /transfer/ |
| Disallow | /Trash/ |
Warnings
- 1 invalid line.
Comments