netweather.tv
robots.txt

Robots Exclusion Standard data for netweather.tv

Resource Scan

Scan Details

Site Domain netweather.tv
Base Domain netweather.tv
Scan Status Ok
Last Scan2024-05-08T04:32:00+00:00
Next Scan 2024-05-15T04:32:00+00:00

Last Scan

Scanned2024-05-08T04:32:00+00:00
URL https://netweather.tv/robots.txt
Redirect https://www.netweather.tv/robots.txt
Redirect Domain www.netweather.tv
Redirect Base netweather.tv
Domain IPs 104.20.57.27, 104.20.58.27, 172.67.32.105, 2606:4700:10::6814:391b, 2606:4700:10::6814:3a1b, 2606:4700:10::ac43:2069
Redirect IPs 104.20.57.27, 104.20.58.27, 172.67.32.105, 2606:4700:10::6814:391b, 2606:4700:10::6814:3a1b, 2606:4700:10::ac43:2069
Response IP 172.67.32.105
Found Yes
Hash 8883ffdc07317abc66603c496bad23f858ecc020db8b839a7a020198a1705f92
SimHash 04550700f830

Groups

rogerbot

Rule Path
Disallow /forum/
Disallow /secure/cgi-bin/premium.pl?*

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /index.cgi?action=fav%3B*
Disallow /index.cgi?action=uk7dayx6%3B*
Disallow /index.cgi?action=uk7dayx5%3B*
Disallow /index.cgi?action=uk7dayx4%3B*
Disallow /index.cgi?action=uk7dayx3%3B*
Disallow /index.cgi?action=uk7day%3B*
Disallow /index.cgi?action=uk7day2%3B*
Disallow /index.cgi?action=uk7dayx10%3B*
Disallow /index.cgi?action=uk7dayxtest%3B*
Disallow /index.cgi?0.*
Disallow /indx.cgi?*
Disallow /index.cgi?action=uk714day2%3B*
Disallow /index.cgi?action=uk714day3%3B*
Disallow /weather-forecasts/uk/14-day/*/*
Disallow /*?PageSpeed=noscript
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.netweather.tv/sitemappostcode.xml
sitemap https://www.netweather.tv/sitemap7day.xml
sitemap https://www.netweather.tv/sitemapworld.xml
sitemap https://www.netweather.tv/sitemap14day.xml
sitemap https://www.netweather.tv/sitemapwist.xml
sitemap https://www.netweather.tv/sitemapwillitsnow.xml
sitemap https://www.netweather.tv/sitemapski.xml

Comments

  • Disallow: /weather-forecasts/uk/7-day/*/*
  • Sitemap URL