metoffice.gov.uk
robots.txt
Robots Exclusion Standard data for metoffice.gov.uk
Resource Scan
Scan Details
| Site Domain | metoffice.gov.uk |
| Base Domain | metoffice.gov.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-11T09:51:32+00:00 |
| Next Scan | 2024-11-18T09:51:32+00:00 |
Last Scan
| Scanned | 2024-11-11T09:51:32+00:00 |
| URL | https://metoffice.gov.uk/robots.txt |
| Redirect | https://www.metoffice.gov.uk/robots.txt |
| Redirect Domain | www.metoffice.gov.uk |
| Redirect Base | metoffice.gov.uk |
| Domain IPs | 104.89.123.118 |
| Redirect IPs | 23.203.76.245 |
| Response IP | 23.203.76.245 |
| Found | Yes |
| Hash | 54f1e664c2b592542d70ec7134a029c32785ae69a95b60d06d57563241fbdebd |
| SimHash | 619d84455335 |
Groups
swiftbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Year/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Year/ |
| Disallow | /blog/facet/Authors/ |
| Disallow | /blog/facet/Categories/ |
| Disallow | /blog/facet/Tags/ |
| Disallow | /blog/facet/Date/ |
| Disallow | /about-us/press-office/news/corporate/facet/Topic/ |
| Disallow | /about-us/press-office/news/corporate/facet/Year/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Topic/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Year/ |
*
| Rule | Path |
|---|---|
| Disallow | /alive/ |
| Disallow | /brand/ |
| Disallow | /conference/ |
| Disallow | /images/ |
| Disallow | /lib/ |
| Disallow | /public/data/ |
| Disallow | /public/weather/lib/ |
| Disallow | /eurocontrol/ |
| Disallow | /magister/ |
| Disallow | /premium/ |
| Disallow | /weather/africa/lam/ |
| Disallow | /alive/ |
| Disallow | /images/ |
| Disallow | /lib/ |
| Disallow | /staff |
| Disallow | /weather/test/ |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Year/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Year/ |
| Disallow | /blog/facet/Authors/ |
| Disallow | /blog/facet/Categories/ |
| Disallow | /blog/facet/Tags/ |
| Disallow | /blog/facet/Date/ |
| Disallow | /about-us/press-office/news/corporate/facet/Topic/ |
| Disallow | /about-us/press-office/news/corporate/facet/Year/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Topic/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Year/ |
proximic
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/corporate-news/facet/Year/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Topic/ |
| Disallow | /about-us/news-and-media/media-centre/weather-and-climate-news/facet/Year/ |
| Disallow | /blog/facet/Authors/ |
| Disallow | /blog/facet/Categories/ |
| Disallow | /blog/facet/Tags/ |
| Disallow | /blog/facet/Date/ |
| Disallow | /about-us/press-office/news/corporate/facet/Topic/ |
| Disallow | /about-us/press-office/news/corporate/facet/Year/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Topic/ |
| Disallow | /about-us/press-office/news/weather-and-climate/facet/Year/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.metoffice.gov.uk/sitemap.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-domestic-forecast.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-international-forecast.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-international-hub.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-regional-hub.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-international-observation.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-domestic-observation.xml |
| sitemap | https://www.metoffice.gov.uk/sitemap-beach.xml |