baz.ch
robots.txt

Robots Exclusion Standard data for baz.ch

Resource Scan

Scan Details

Site Domain baz.ch
Base Domain baz.ch
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-23T06:39:50+00:00
Next Scan 2024-05-30T06:39:50+00:00

Last Successful Scan

Scanned2024-04-22T04:30:55+00:00
URL https://baz.ch/robots.txt
Redirect https://www.bazonline.ch/robots.txt
Redirect Domain www.bazonline.ch
Redirect Base bazonline.ch
Domain IPs 212.243.165.93
Redirect IPs 18.239.199.103, 18.239.199.27, 18.239.199.42, 18.239.199.51, 2600:9000:25ef:2400:e:5a66:ac0:93a1, 2600:9000:25ef:2600:e:5a66:ac0:93a1, 2600:9000:25ef:9200:e:5a66:ac0:93a1, 2600:9000:25ef:a400:e:5a66:ac0:93a1, 2600:9000:25ef:bc00:e:5a66:ac0:93a1, 2600:9000:25ef:d400:e:5a66:ac0:93a1, 2600:9000:25ef:da00:e:5a66:ac0:93a1, 2600:9000:25ef:f600:e:5a66:ac0:93a1
Response IP 18.165.171.66
Found Yes
Hash 9dcec52dc344f208d388ce1a73f150ba8a43b128e5ee0c86226791273ee40fb7
SimHash 701e89405337

Groups

psbot
yandex
petalbot
mail.ru_bot
megaindex
baiduspider
yisouspider
bytespider
sogou web spider
sogou inst spider
proximic
admantx
seekport crawler
semrushbot
blexbot
mj12bot
dotbot
gptbot
ccbot
google-extended

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bazonline.ch/sitemaps/sitemapindex.xml
sitemap https://www.bazonline.ch/sitemaps/news.xml

Comments

  • Disallow commercial bots to prevent ad fraud, see DISC-2117
  • Allow crawling for other bots

Warnings

  • 1 invalid line.