peterhans-hwz.ch
robots.txt

Robots Exclusion Standard data for peterhans-hwz.ch

Resource Scan

Scan Details

Site Domain peterhans-hwz.ch
Base Domain peterhans-hwz.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-03T19:10:01+00:00
Next Scan 2024-10-01T19:10:01+00:00

Last Successful Scan

Scanned2024-02-12T18:59:11+00:00
URL https://peterhans-hwz.ch/robots.txt
Domain IPs 89.58.3.30
Response IP 89.58.3.30
Found Yes
Hash 2b83c4132b0e78153d52af9922168a138ca9f7bdeb0665c7e2f73b5bbd9c498d
SimHash 603c54425610

Groups

*

Rule Path
Disallow /admin/
Disallow /pages/
Disallow /pages2015/
Disallow /pagesshop/
Disallow /upload/
Disallow /www_partner/
Disallow /scripts/
Disallow /services/
Disallow /?rub=1505&id=21668
Disallow /?rub=1502&id=21662
Disallow /?rub=1499&id=21655

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.