lions.ch
robots.txt

Robots Exclusion Standard data for lions.ch

Resource Scan

Scan Details

Site Domain lions.ch
Base Domain lions.ch
Scan Status Ok
Last Scan2024-10-11T01:17:47+00:00
Next Scan 2024-10-25T01:17:47+00:00

Last Scan

Scanned2024-10-11T01:17:47+00:00
URL https://lions.ch/robots.txt
Redirect https://www.lions.ch/robots.txt
Redirect Domain www.lions.ch
Redirect Base lions.ch
Domain IPs 104.21.64.145, 172.67.151.148, 2606:4700:3032::ac43:9794, 2606:4700:3035::6815:4091
Redirect IPs 104.21.64.145, 172.67.151.148, 2606:4700:3032::ac43:9794, 2606:4700:3035::6815:4091
Response IP 172.67.151.148
Found Yes
Hash 170ec2883db8204f097ef87d759887cf1eeaf8c2be0af8d3730aef7e8a040a2a
SimHash 0268d812903b

Groups

chatgpt-user

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

vscooter

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

taptubot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

infopath

Rule Path
Disallow /

infopath.2

Rule Path
Disallow /

swebot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

searchmetericsbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf

semrushbot-sa

Rule Path
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf

slurp

Rule Path
Disallow /*.jpg
Disallow /*.png
Disallow /*.PDF
Disallow /*.pdf
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf
Disallow /de/login.html
Disallow /fr/login.html
Disallow /it/login.html
Disallow /en/login.html

googlebot

Rule Path
Disallow /*.jpg$
Disallow /*.JPG$
Disallow /*.png$
Disallow /*.PDF$
Disallow /*.pdf$
Disallow /*.MOV
Disallow /*.mov
Disallow /*.AVI
Disallow /*.avi
Disallow /DSCN*.htm
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf
Disallow /de/login.html
Disallow /fr/login.html
Disallow /it/login.html
Disallow /en/login.html

exabot

Rule Path
Disallow /*.jpg$
Disallow /*.JPG$
Disallow /*.png$
Disallow /*.PDF$
Disallow /*.pdf$
Disallow /*.MOV$
Disallow /*.mov$
Disallow /*.AVI$
Disallow /*.avi$
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf
Disallow /de/login.html
Disallow /fr/login.html
Disallow /it/login.html
Disallow /en/login.html

Other Records

Field Value
crawl-delay 3600

msnbot

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.PDF$
Disallow /*.pdf$
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf
Disallow /de/login.html
Disallow /fr/login.html
Disallow /it/login.html
Disallow /en/login.html

*

Rule Path
Disallow /*.jpg
Disallow /*.png
Disallow /*.PDF
Disallow /*.pdf
Disallow /typo3
Disallow /typo3temp
Disallow /typo3conf
Disallow /de/login.html
Disallow /fr/login.html
Disallow /it/login.html
Disallow /en/login.html

Other Records

Field Value
sitemap https://www.lions.ch/de/sitemap.xml
sitemap https://www.lions.ch/en/sitemap.xml
sitemap https://www.lions.ch/fr/sitemap.xml
sitemap https://www.lions.ch/it/sitemap.xml
sitemap https://www.lions.ch/de/district-west/sitemap/news/sitemap.xml
sitemap https://www.lions.ch/de/district-ost/sitemap/news/sitemap.xml
sitemap https://www.lions.ch/de/district-centro/sitemap/news/sitemap.xml