immerag.ch
robots.txt

Robots Exclusion Standard data for immerag.ch

Resource Scan

Scan Details

Site Domain immerag.ch
Base Domain immerag.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-10T13:48:15+00:00
Next Scan 2024-12-09T13:48:15+00:00

Last Successful Scan

Scanned2024-07-20T12:03:39+00:00
URL https://immerag.ch/robots.txt
Domain IPs 89.58.30.247
Response IP 89.58.30.247
Found Yes
Hash 7dda82f36c8ef4954eb52db19decada23478504ac60547fe9eba31a07dcb2f4e
SimHash 633c5440de10

Groups

*

Rule Path
Disallow /admin/
Disallow /adminshop/
Disallow /pages/
Disallow /pages2015/
Disallow /pagesshop/
Disallow /pagespartner/
Disallow /upload/
Disallow /www_partner/
Disallow /scripts/
Disallow /services/
Disallow /?rub=1505&id=21668
Disallow /?rub=1502&id=21662
Disallow /?rub=1499&id=21655

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.immerag.ch/sitemap.xml

Warnings

  • 4 invalid lines.