webcafe.co.za
robots.txt
Robots Exclusion Standard data for webcafe.co.za
Resource Scan
Scan Details
| Site Domain | webcafe.co.za |
| Base Domain | webcafe.co.za |
| Scan Status | Ok |
| Last Scan | 2026-01-04T08:18:51+00:00 |
| Next Scan | 2026-02-03T08:18:51+00:00 |
Last Scan
| Scanned | 2026-01-04T08:18:51+00:00 |
| URL | https://www.webcafe.co.za/robots.txt |
| Domain IPs | 104.21.78.56, 172.67.217.52, 2606:4700:3034::6815:4e38, 2606:4700:3034::ac43:d934 |
| Response IP | 104.21.78.56 |
| Found | Yes |
| Hash | e16fe6200790888f2f8b54773bbd1b4056bc4257e4d8638a24a29784343ca21f |
| SimHash | e98188226fb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wc-logs/ |
| Disallow | /wp-content/uploads/woocommerce_transient_files/ |
| Disallow | /wp-content/uploads/woocommerce_uploads/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.webcafe.co.za/wp-sitemap.xml |