myguidebotswana.com
robots.txt
Robots Exclusion Standard data for myguidebotswana.com
Resource Scan
Scan Details
| Site Domain | myguidebotswana.com |
| Base Domain | myguidebotswana.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-25T15:50:53+00:00 |
| Next Scan | 2025-10-02T15:50:53+00:00 |
Last Successful Scan
| Scanned | 2025-08-25T00:09:21+00:00 |
| URL | https://myguidebotswana.com/robots.txt |
| Redirect | https://www.myguidebotswana.com/robots.txt |
| Redirect Domain | www.myguidebotswana.com |
| Redirect Base | myguidebotswana.com |
| Domain IPs | 3.165.102.127, 3.165.102.13, 3.165.102.46, 3.165.102.78 |
| Redirect IPs | 3.165.102.127, 3.165.102.13, 3.165.102.46, 3.165.102.78 |
| Response IP | 3.165.102.13 |
| Found | Yes |
| Hash | 1f0fa237c08fd87b7412d5c26e824bdb97b618fe488938d60d35d862db705a59 |
| SimHash | 6a059855cf95 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/* |
| Disallow | /admin/* |
| Disallow | /modal/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.myguidebotswana.com/sitemap.xml |