fr.africanews.com
robots.txt
Robots Exclusion Standard data for fr.africanews.com
Resource Scan
Scan Details
| Site Domain | fr.africanews.com |
| Base Domain | africanews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T23:45:46+00:00 |
| Next Scan | 2024-11-21T23:45:46+00:00 |
Last Scan
| Scanned | 2024-11-14T23:45:46+00:00 |
| URL | https://fr.africanews.com/robots.txt |
| Domain IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 199.232.45.91 |
| Found | Yes |
| Hash | 9103f73a9091101e4cd76c1be37ac5a1824af0e78ee127d5f2001f8d9726ce7b |
| SimHash | 4e0df542be96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /media/Player6_0.swf* |
| Disallow | js/main-*.js |
| Disallow | js/streamsense-*.min.js |
| Disallow | /modules |
| Disallow | /plugin |
| Disallow | /src |
| Disallow | /handler |
| Disallow | /utils |
| Disallow | /lib |
| Disallow | /helper |
| Disallow | /update_ |
| Disallow | /instances |
| Disallow | /dom |
| Disallow | /class |
| Disallow | /client |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fr.africanews.com/sitemaps/fr/sitemap.xml |
Comments