net-weather.co.uk
robots.txt

Robots Exclusion Standard data for net-weather.co.uk

Resource Scan

Scan Details

Site Domain net-weather.co.uk
Base Domain net-weather.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-05T21:38:17+00:00
Next Scan 2026-01-03T21:38:17+00:00

Last Successful Scan

Scanned2024-06-13T11:58:33+00:00
URL https://net-weather.co.uk/robots.txt
Redirect https://www.netweather.tv/robots.txt
Redirect Domain www.netweather.tv
Redirect Base netweather.tv
Domain IPs 104.21.9.4, 172.67.130.202, 2606:4700:3034::ac43:82ca, 2606:4700:3037::6815:904
Redirect IPs 104.20.57.27, 104.20.58.27, 172.67.32.105, 2606:4700:10::6814:391b, 2606:4700:10::6814:3a1b, 2606:4700:10::ac43:2069
Response IP 104.20.58.27
Found Yes
Hash c37972d7e23f270a77679e851284ab502cafd9125e2259afcfc2d734e63c28a5
SimHash 04550700f830

Groups

rogerbot

Rule Path
Disallow /forum/
Disallow /secure/cgi-bin/premium.pl?*

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /index.cgi?action=fav%3B*
Disallow /index.cgi?action=uk7dayx6%3B*
Disallow /index.cgi?action=uk7dayx5%3B*
Disallow /index.cgi?action=uk7dayx4%3B*
Disallow /index.cgi?action=uk7dayx3%3B*
Disallow /index.cgi?action=uk7day%3B*
Disallow /index.cgi?action=uk7day2%3B*
Disallow /index.cgi?action=uk7dayx10%3B*
Disallow /index.cgi?action=uk7dayxtest%3B*
Disallow /index.cgi?0.*
Disallow /indx.cgi?*
Disallow /index.cgi?action=uk714day2%3B*
Disallow /index.cgi?action=uk714day3%3B*
Disallow /weather-forecasts/uk/14-day/*/*
Disallow /*?PageSpeed=noscript
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.netweather.tv/sitemappostcode.xml
sitemap https://www.netweather.tv/sitemap7day.xml
sitemap https://www.netweather.tv/sitemap7day1.xml
sitemap https://www.netweather.tv/sitemapworld.xml
sitemap https://www.netweather.tv/sitemap14day.xml
sitemap https://www.netweather.tv/sitemapwist.xml
sitemap https://www.netweather.tv/sitemapwillitsnow.xml
sitemap https://www.netweather.tv/sitemapski.xml

Comments

  • Disallow: /weather-forecasts/uk/7-day/*/*
  • Sitemap URL