tanzaniaweb.live
robots.txt
Robots Exclusion Standard data for tanzaniaweb.live
Resource Scan
Scan Details
Site Domain | tanzaniaweb.live |
Base Domain | tanzaniaweb.live |
Scan Status | Ok |
Last Scan | 2024-09-16T10:55:49+00:00 |
Next Scan | 2024-09-23T10:55:49+00:00 |
Last Scan
Scanned | 2024-09-16T10:55:49+00:00 |
URL | https://tanzaniaweb.live/robots.txt |
Domain IPs | 104.21.86.69, 172.67.216.140, 2606:4700:3034::6815:5645, 2606:4700:3035::ac43:d88c |
Response IP | 172.67.216.140 |
Found | Yes |
Hash | 5c9e028c0d95238705ea6036f7f1ab3fb883b169c678bec4ce9eab9dce769163 |
SimHash | aa76d4208c93 |
Groups
*
Rule | Path |
---|---|
Disallow | *feedback.php |
Disallow | /cdn-cgi/ |
Disallow | /headlines/ |
Disallow | *?audio=1 |
Disallow | /validate_user.php?url=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.tanzaniaweb.live/sitemaps/sitemap.xml |
sitemap | https://www.tanzaniaweb.live/sitemaps/articles.xml |
sitemap | https://www.tanzaniaweb.live/sitemaps/news.xml |
Comments