baseljetzt.ch
robots.txt

Robots Exclusion Standard data for baseljetzt.ch

Resource Scan

Scan Details

Site Domain baseljetzt.ch
Base Domain baseljetzt.ch
Scan Status Ok
Last Scan2024-09-23T12:45:32+00:00
Next Scan 2024-09-30T12:45:32+00:00

Last Scan

Scanned2024-09-23T12:45:32+00:00
URL https://baseljetzt.ch/robots.txt
Redirect https://www.baseljetzt.ch/robots.txt
Redirect Domain www.baseljetzt.ch
Redirect Base baseljetzt.ch
Domain IPs 194.183.147.36
Redirect IPs 194.183.147.36
Response IP 194.183.147.36
Found Yes
Hash 94d6ed1688df15b2e8ba9e2844075d3da11276be51043279985f31b1adf9f67d
SimHash 0a3cc160c353

Groups

*

Rule Path
Allow /

yandexbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.baseljetzt.ch/sitemap-news.xml
sitemap https://www.baseljetzt.ch/sitemap.xml

Comments

  • Google Image
  • Archive.org Bot
  • SEMrushBot