learningenglish.voanews.com
robots.txt
Robots Exclusion Standard data for learningenglish.voanews.com
Resource Scan
Scan Details
| Site Domain | learningenglish.voanews.com |
| Base Domain | voanews.com |
| Scan Status | Ok |
| Last Scan | 2024-06-03T04:14:55+00:00 |
| Next Scan | 2024-06-17T04:14:55+00:00 |
Last Scan
| Scanned | 2024-06-03T04:14:55+00:00 |
| URL | https://learningenglish.voanews.com/robots.txt |
| Domain IPs | 184.30.15.174, 2600:1417:3f:b8f::131b, 2600:1417:3f:bb9::131b |
| Response IP | 96.16.170.12 |
| Found | Yes |
| Hash | 0eb73a575f668b8f3867b2d97a3b7b096e2c9e5e590873533077ef20a65871bb |
| SimHash | 700c8846fa11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /z/*/*/*/* |
| Disallow | /ebar* |
| Disallow | /api/* |
| Disallow | /tv/*/*/*/*/* |
| Disallow | /radio/*/*/*/*/* |
| Disallow | /schedule/*/*/*/*/* |
| Disallow | /*?p=* |
| Disallow | /comments/* |
| Disallow | /embed/* |
| Disallow | /s?k=* |
| Disallow | /navigation.html |
| Disallow | /captcha/iframe.html |
| Disallow | /office365/login.html |
| Disallow | /podcast/sublink/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://learningenglish.voanews.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.