fuw.ch
robots.txt

Robots Exclusion Standard data for fuw.ch

Resource Scan

Scan Details

Site Domain fuw.ch
Base Domain fuw.ch
Scan Status Ok
Last Scan2024-11-06T09:44:58+00:00
Next Scan 2024-11-13T09:44:58+00:00

Last Scan

Scanned2024-11-06T09:44:58+00:00
URL https://fuw.ch/robots.txt
Redirect https://www.fuw.ch/robots.txt
Redirect Domain www.fuw.ch
Redirect Base fuw.ch
Domain IPs 2600:9000:2795:5200:e:5a66:ac0:93a1, 2600:9000:2795:9200:e:5a66:ac0:93a1, 2600:9000:2795:c000:e:5a66:ac0:93a1, 2600:9000:2795:c200:e:5a66:ac0:93a1, 2600:9000:2795:c800:e:5a66:ac0:93a1, 2600:9000:2795:ca00:e:5a66:ac0:93a1, 2600:9000:2795:d800:e:5a66:ac0:93a1, 2600:9000:2795:dc00:e:5a66:ac0:93a1, 3.164.85.11, 3.164.85.59, 3.164.85.64, 3.164.85.95
Redirect IPs 2600:9000:2795:1a00:e:5a66:ac0:93a1, 2600:9000:2795:1c00:e:5a66:ac0:93a1, 2600:9000:2795:3600:e:5a66:ac0:93a1, 2600:9000:2795:4200:e:5a66:ac0:93a1, 2600:9000:2795:7200:e:5a66:ac0:93a1, 2600:9000:2795:9c00:e:5a66:ac0:93a1, 2600:9000:2795:b800:e:5a66:ac0:93a1, 2600:9000:2795:bc00:e:5a66:ac0:93a1, 3.164.85.11, 3.164.85.59, 3.164.85.64, 3.164.85.95
Response IP 52.85.49.111
Found Yes
Hash fa980d280d9a069764a8099fda41160bc9f3be4276c38ccdf55d08a0a81af35c
SimHash 50168b40db33

Groups

psbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

admantx

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.fuw.ch/sitemaps/sitemapindex.xml
sitemap https://www.fuw.ch/sitemaps/news.xml

Comments

  • Disallow commercial bots to prevent ad fraud, see DISC-2117
  • Allow crawling for other bots

Warnings

  • 2 invalid lines.