Log In Sign Up

mobile.fuw.ch
robots.txt

Robots Exclusion Standard data for mobile.fuw.ch

Resource Scan

Scan Details

Site Domain mobile.fuw.ch
Base Domain fuw.ch
Scan Status Ok
Last Scan2024-06-03T19:34:17+00:00
Next Scan 2024-06-10T19:34:17+00:00

Last Scan

Scanned2024-06-03T19:34:17+00:00
URL https://mobile.fuw.ch/robots.txt
Redirect https://www.fuw.ch/robots.txt
Redirect Domain www.fuw.ch
Redirect Base fuw.ch
Domain IPs 104.18.16.127, 104.18.17.127, 2606:4700::6812:107f, 2606:4700::6812:117f
Redirect IPs 18.239.199.103, 18.239.199.27, 18.239.199.42, 18.239.199.51, 2600:9000:26cc:4600:e:5a66:ac0:93a1, 2600:9000:26cc:6600:e:5a66:ac0:93a1, 2600:9000:26cc:7600:e:5a66:ac0:93a1, 2600:9000:26cc:7e00:e:5a66:ac0:93a1, 2600:9000:26cc:a000:e:5a66:ac0:93a1, 2600:9000:26cc:c00:e:5a66:ac0:93a1, 2600:9000:26cc:e600:e:5a66:ac0:93a1, 2600:9000:26cc:f200:e:5a66:ac0:93a1
Response IP 18.165.171.66
Found Yes
Hash 1dd7ac817c34ab078217cea2f230d7f73ab19daaec42bcae6f19dde9d3ac9f0f
SimHash d01e89405b37

Groups

psbot
yandex
petalbot
mail.ru_bot
megaindex
baiduspider
yisouspider
bytespider
sogou web spider
sogou inst spider
proximic
admantx
seekport crawler
semrushbot
blexbot
mj12bot
dotbot
gptbot
ccbot
google-extended

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.fuw.ch/sitemaps/sitemapindex.xml
sitemap https://www.fuw.ch/sitemaps/news.xml
Back to top

Comments

  • Disallow commercial bots to prevent ad fraud, see DISC-2117
  • Allow crawling for other bots
Back to top

Warnings

  • 1 invalid line.
Back to top