weatheronline.co.uk
robots.txt

Robots Exclusion Standard data for weatheronline.co.uk

Resource Scan

Scan Details

Site Domain weatheronline.co.uk
Base Domain weatheronline.co.uk
Scan Status Ok
Last Scan2024-09-22T11:27:08+00:00
Next Scan 2024-09-29T11:27:08+00:00

Last Scan

Scanned2024-09-22T11:27:08+00:00
URL https://weatheronline.co.uk/robots.txt
Domain IPs 104.21.59.179, 172.67.182.8, 2606:4700:3033::ac43:b608, 2606:4700:3036::6815:3bb3
Response IP 172.67.182.8
Found Yes
Hash 5c3295fc3fbbd099911de95f1784e666afb59ec22c3c7d96a06b715c4019afc6
SimHash 6d06c6060713

Groups

googlebot-image

Rule Path
Disallow /daten/proficharts/en/
Disallow /reports/philip-eden/
Disallow /

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /wap/
Disallow /ton/
Disallow /wml2html/
Disallow /wb/
Disallow /werbung/
Disallow /reports/philip-eden/
Allow /

Other Records

Field Value
sitemap https://www.weatheronline.co.uk/sitemap_en.xml
sitemap https://www.weatheronline.co.uk/sitemap_en_trend.xml
sitemap https://www.weatheronline.co.uk/sitemap_all.xml

Comments

  • Anweisungen für Bing:
  • User-agent: bingbot
  • Disallow: /ton/
  • Disallow: /css/
  • Disallow: /karten/
  • Crawl-delay: 8