tonight.co.za
robots.txt
Robots Exclusion Standard data for tonight.co.za
Resource Scan
Scan Details
| Site Domain | tonight.co.za |
| Base Domain | tonight.co.za |
| Scan Status | Ok |
| Last Scan | 2024-11-14T20:58:05+00:00 |
| Next Scan | 2024-11-21T20:58:05+00:00 |
Last Scan
| Scanned | 2024-11-14T20:58:05+00:00 |
| URL | https://tonight.co.za/robots.txt |
| Domain IPs | 104.21.63.162, 172.67.171.14, 2606:4700:3030::6815:3fa2, 2606:4700:3037::ac43:ab0e |
| Response IP | 172.67.171.14 |
| Found | Yes |
| Hash | 5fce38735b9f3c5a24d079db6ed19cbfbf5406cf16d5193652af0762c7d1c279 |
| SimHash | c9f61c04fff1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?z= |
| Disallow | *?q= |
| Disallow | */preview/ |
| Disallow | /menu/ |
| Disallow | /menu |
| Disallow | /menu?* |
| Disallow | /print-content* |
| Disallow | /widgets/rss_redirect.php?* |
| Disallow | /index.php?* |
| Disallow | /test$ |
| Disallow | /test1$ |
| Disallow | /test2$ |
| Disallow | /my-notifications |
| Disallow | /my-bookmarks |
| Disallow | /business-report/test$ |
| Disallow | /news/test$ |
| Disallow | /personal-finance/test$ |
| Disallow | /sport/test$ |
| Disallow | /entertainment/test$ |
| Disallow | /lifestyle/test$ |
| Disallow | /travel/test$ |
| Disallow | /motoring/test$ |
| Disallow | /wap.iol.co.za/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.iol.co.za/sitemap.xml |