news.bbc.co.uk
robots.txt
Robots Exclusion Standard data for news.bbc.co.uk
Resource Scan
Scan Details
| Site Domain | news.bbc.co.uk |
| Base Domain | bbc.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-02-18T03:15:00+00:00 |
| Next Scan | 2025-03-20T03:15:00+00:00 |
Last Scan
| Scanned | 2025-02-18T03:15:00+00:00 |
| URL | https://news.bbc.co.uk/robots.txt |
| Domain IPs | 212.58.244.56, 212.58.249.144 |
| Response IP | 212.58.249.145 |
| Found | Yes |
| Hash | fbf1bac1edf0adb148cf5c3ff48c4190a9a4c90a0731dd59bbe68e30eb574dbc |
| SimHash | 781349c8a6a2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /cgi-perl |
| Disallow | /lexaurus |
| Disallow | /mpapps |
| Disallow | /mpsearch |
| Disallow | /mtk |
| Disallow | /weatherbeta |
| Disallow | /weather/hi/about/newsid_7760000/7760846.stm |
| Disallow | /1/hi/help/8594343.stm |
| Disallow | /2/hi/help/8594343.stm |
| Disallow | /1/hi/help/8594488.stm |
| Disallow | /2/hi/help/8594488.stm |
| Disallow | /1/hi/uk/1494064.stm |
| Disallow | /1/hi/health/363959.stm |
| Disallow | /1/hi/health/4749331.stm |
| Disallow | /1/hi/england/1678616.stm |
| Disallow | /1/hi/education/3826037.stm |
| Disallow | /1/shared/spl/hi/pop_ups/05/uk_should_the_uk_vote_on_the_eu_constitution0/html/8.stm |
| Disallow | /1/hi/england/beds/bucks/herts/3663494.stm |
| Disallow | /2/hi/uk_news/england/beds/bucks/herts/3663494.stm |
Other Records
| Field | Value |
|---|---|
| sitemap | http://news.bbc.co.uk/weather/sitemap.xml |
| sitemap | http://news.bbc.co.uk/weather/sitemap_mobile.xml |
Comments