peterhans-hwz.ch
robots.txt

Robots Exclusion Standard data for peterhans-hwz.ch

Resource Scan

Scan Details

Site Domain peterhans-hwz.ch
Base Domain peterhans-hwz.ch
Scan Status Ok
Last Scan2024-10-31T19:10:25+00:00
Next Scan 2024-11-30T19:10:25+00:00

Last Scan

Scanned2024-10-31T19:10:25+00:00
URL https://peterhans-hwz.ch/robots.txt
Domain IPs 89.58.3.30
Response IP 89.58.3.30
Found Yes
Hash 8a501fe374251e9742855b7b93e6baf9a229c288fc10dbdb57434bf6665bf7ef
SimHash 603c54405610

Groups

*

Rule Path
Disallow /admin/
Disallow /pages/
Disallow /pages2015/
Disallow /pagesshop/
Disallow /upload/
Disallow /www_partner/
Disallow /scripts/
Disallow /services/
Disallow /?rub=1505&id=21668
Disallow /?rub=1502&id=21662
Disallow /?rub=1499&id=21655

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.peterhans-hwz.ch/sitemap.xml

Warnings

  • 4 invalid lines.