shop.fehrbraunwalder.ch
robots.txt

Robots Exclusion Standard data for shop.fehrbraunwalder.ch

Resource Scan

Scan Details

Site Domain shop.fehrbraunwalder.ch
Base Domain fehrbraunwalder.ch
Scan Status Ok
Last Scan2024-06-01T14:06:07+00:00
Next Scan 2024-06-15T14:06:07+00:00

Last Scan

Scanned2024-06-01T14:06:07+00:00
URL https://shop.fehrbraunwalder.ch/robots.txt
Domain IPs 45.129.183.128
Response IP 45.129.183.128
Found Yes
Hash c7a13e4b88d1d76430b04247c796f9ccc107ebb698280a68c4702f0eb8f0593e
SimHash 633c54425718

Groups

*

Rule Path
Disallow /admin/
Disallow /adminshop/
Disallow /pages/
Disallow /pages2015/
Disallow /pagesshop/
Disallow /pagespartner/
Disallow /upload/
Disallow /www_partner/
Disallow /scripts/
Disallow /services/
Disallow /?rub=1505&id=21668
Disallow /?rub=1502&id=21662
Disallow /?rub=1499&id=21655

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.