weatheronline.pt
robots.txt

Robots Exclusion Standard data for weatheronline.pt

Resource Scan

Scan Details

Site Domain weatheronline.pt
Base Domain weatheronline.pt
Scan Status Ok
Last Scan2024-09-28T06:03:37+00:00
Next Scan 2024-10-05T06:03:37+00:00

Last Scan

Scanned2024-09-28T06:03:37+00:00
URL https://weatheronline.pt/robots.txt
Domain IPs 104.21.68.15, 172.67.184.219, 2606:4700:3031::ac43:b8db, 2606:4700:3035::6815:440f
Response IP 104.21.68.15
Found Yes
Hash 3e5a1422337b46e0a557d52c88dafa5129dd95e11b82385914bf0b64956b50df
SimHash 6926c6020793

Groups

googlebot-image

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /wap/
Disallow /ton/
Disallow /wml2html/
Disallow /wb/
Disallow /werbung/
Disallow /reports/philip-eden/
Allow /

Other Records

Field Value
sitemap https://www.weatheronline.pt/sitemap_pt.xml
sitemap https://www.weatheronline.pt/sitemap_pt_trend.xml
sitemap https://www.weatheronline.pt/sitemap_all.xml

Comments

  • Anweisungen für Bing:
  • User-agent: bingbot
  • Disallow: /ton/
  • Disallow: /css/
  • Disallow: /karten/
  • Crawl-delay: 8