dailyvoice.co.za
robots.txt
Robots Exclusion Standard data for dailyvoice.co.za
Resource Scan
Scan Details
Site Domain | dailyvoice.co.za |
Base Domain | dailyvoice.co.za |
Scan Status | Ok |
Last Scan | 2024-11-12T22:36:47+00:00 |
Next Scan | 2024-11-19T22:36:47+00:00 |
Last Scan
Scanned | 2024-11-12T22:36:47+00:00 |
URL | https://dailyvoice.co.za/robots.txt |
Redirect | https://www.dailyvoice.co.za/robots.txt |
Redirect Domain | www.dailyvoice.co.za |
Redirect Base | dailyvoice.co.za |
Domain IPs | 104.21.0.254, 172.67.151.159, 2606:4700:3032::ac43:979f, 2606:4700:3036::6815:fe |
Redirect IPs | 104.21.0.254, 172.67.151.159, 2606:4700:3032::ac43:979f, 2606:4700:3036::6815:fe |
Response IP | 104.21.0.254 |
Found | Yes |
Hash | 47949f4b8ca124a2ce6f0c17a2b856b90c005268b617774d52505207039530e6 |
SimHash | a9241e40afb2 |
Groups
*
Rule | Path |
---|---|
Disallow | *?z= |
Disallow | *?q= |
Disallow | */preview/ |
Disallow | /menu/ |
Disallow | /menu |
Disallow | /menu?* |
Disallow | /print-content* |
Disallow | /widgets/rss_redirect.php?* |
Disallow | /index.php?* |
Disallow | /test$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.dailyvoice.co.za/sitemap.xml |