africanews.com
robots.txt
Robots Exclusion Standard data for africanews.com
Resource Scan
Scan Details
| Site Domain | africanews.com |
| Base Domain | africanews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T09:21:43+00:00 |
| Next Scan | 2024-11-20T09:21:43+00:00 |
Last Scan
| Scanned | 2024-11-13T09:21:43+00:00 |
| URL | https://africanews.com/robots.txt |
| Redirect | https://www.africanews.com:443/robots.txt |
| Redirect Domain | www.africanews.com |
| Redirect Base | africanews.com |
| Domain IPs | 34.255.127.216, 52.18.226.78, 54.76.89.217 |
| Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 199.232.45.91 |
| Found | Yes |
| Hash | 559a034f67a5c1191ef10604bf42c490e31f24b171070a0c039c28f2a2cbd7d1 |
| SimHash | 4a0df446be16 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /media/Player6_0.swf* |
| Disallow | js/main-*.js |
| Disallow | js/streamsense-*.min.js |
| Disallow | /modules |
| Disallow | /plugin |
| Disallow | /src |
| Disallow | /handler |
| Disallow | /utils |
| Disallow | /lib |
| Disallow | /helper |
| Disallow | /update_ |
| Disallow | /instances |
| Disallow | /dom |
| Disallow | /class |
| Disallow | /client |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.africanews.com/sitemaps/en/sitemap.xml |
Comments