shop.weberprevost.ch
robots.txt

Robots Exclusion Standard data for shop.weberprevost.ch

Resource Scan

Scan Details

Site Domain shop.weberprevost.ch
Base Domain weberprevost.ch
Scan Status Ok
Last Scan2024-09-02T04:54:18+00:00
Next Scan 2024-10-02T04:54:18+00:00

Last Scan

Scanned2024-09-02T04:54:18+00:00
URL https://shop.weberprevost.ch/robots.txt
Domain IPs 202.61.237.5
Response IP 202.61.237.5
Found Yes
Hash 253d367727ae64b178f8cd147afec026df34da2a2868546c01c57ffd863af266
SimHash 631454485710

Groups

*

Rule Path
Disallow /admin/
Disallow /adminshop/
Disallow /pages/
Disallow /pages2015/
Disallow /pagesshop/
Disallow /pagespartner/
Disallow /upload/
Disallow /www_partner/
Disallow /scripts/
Disallow /services/
Disallow /?rub=1505&id=21668
Disallow /?rub=1502&id=21662
Disallow /?rub=1499&id=21655

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shop.weberprevost.ch/sitemap.xml

Warnings

  • 4 invalid lines.