boot24.ch
robots.txt

Robots Exclusion Standard data for boot24.ch

Resource Scan

Scan Details

Site Domain boot24.ch
Base Domain boot24.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-09T16:51:38+00:00
Next Scan 2026-04-09T16:51:38+00:00

Last Successful Scan

Scanned2024-09-17T16:08:43+00:00
URL https://boot24.ch/robots.txt
Domain IPs 172.66.40.195, 172.66.43.61, 2606:4700:3108::ac42:28c3, 2606:4700:3108::ac42:2b3d
Response IP 172.66.43.61
Found Yes
Hash 9b6ff5d5c070ef01ada4d38c52affd8a76e19ae7a41585bea74b78e633a9b94b
SimHash 52081c589548

Groups

*

Rule Path
Disallow /app/
Disallow /modal/
Disallow /send/
Disallow /print/
Disallow /ical/
Disallow /ins/
Disallow /favorites/
Disallow /fotopopup/
Disallow /redirect/
Disallow /pdf/ins/
Disallow /pdf/upload/
Disallow /haendlerseite/
Disallow /user/connectlisting/
Disallow /alinghi/
Disallow /robot/
Disallow /share/
Disallow /report/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex
baiduspider
ia_archiver
amazonbot
seekbot
seekportbot
pompos
solomono
mj12bot
linguee
lwnutch
magpie-crawler
riddlerbot
discoverybot
seokicks
seokicks-robot
endeca webcrawler
blexbot
yisouspider
httrack website copier
sentibot
trendictionbot
contextad bot
umbot
rubrikkbot
admantx
scrapy
seodiver
plukkie
xovibot
wesee
psbot
bubing
voltron
proximic
riddler
bnsbot
mnogosearch
um-fc
domaincrawler
cliqzbot
semrushbot
domaincrawler
turnitinbot
bdcbot
searchmetricsbot
petalbot
majesticseo
backlinkcrawler
spbot
ahrefsbot
ia_archiver
turnitinbot
slysearch
findlinks
pixray-seeker
lb-spider
bytespider
relemindbot
httrack
dataforseobot
fidget-spinner-bot
my-tiny-bot
thesis-research-bot
imagesiftbot
geedobot
awariobot
claudebot
gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.boot24.ch/sitemap.xml

Comments

  • MSN Delay
  • XML Sitemap Index
  • Bots [C]