ekauf.ch
robots.txt

Robots Exclusion Standard data for ekauf.ch

Resource Scan

Scan Details

Site Domain ekauf.ch
Base Domain ekauf.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-26T08:24:48+00:00
Next Scan 2024-08-24T08:24:48+00:00

Last Successful Scan

Scanned2024-01-28T08:00:37+00:00
URL https://ekauf.ch/robots.txt
Domain IPs 104.21.48.108, 172.67.184.44, 2606:4700:3031::ac43:b82c, 2606:4700:3032::6815:306c
Response IP 172.67.184.44
Found Yes
Hash 289f002ee44da0cc7fe0596fc70157c72d58460b6d95b35c1de645a64504e673
SimHash a52269d0c661

Groups

*

Rule Path
Disallow /cache/
Disallow /config/
Disallow /library/
Disallow /module/
Disallow /SQL/
Disallow /stats/
Disallow /error/
Disallow /cron.php
Disallow /install.php
Disallow /error_log
Disallow /*?sort*
Disallow /*?limit*
Disallow /*?parent_id*
Disallow /*?lang=
Disallow /*?SID=
Disallow /admin/
Disallow /install/
Disallow /rss/
Disallow /advert/
Disallow /play-video/
Disallow /app/async*
Disallow /members-area/
Disallow /members/
Disallow /login-modal/
Disallow /register-modal/
Disallow /forgot-username/
Disallow /forgot-password/
Disallow /bid/
Disallow /buy/
Disallow /offer/
Disallow /cart/
Disallow /listings/cart/
Disallow /search/
Disallow /advanced-search/
Disallow /search?*
Disallow /sell/
Disallow /categories/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://ekauf.ch/sitemap.xml

Comments

  • Do not crawl application folders
  • Do not crawl root files
  • Do not crawl pages with sorting or listings per page limit set
  • Do not crawl language change pages
  • Do not crawl links with session ids
  • Do not crawl the admin module
  • Do not crawl the install module
  • Do not crawl selected app module pages
  • - rss pages
  • - advert related pages
  • - play video action
  • async controller
  • Do not crawl selected members module pages
  • Do not crawl selected listings module pages
  • - bid/purchase/cart related pages
  • - search pages
  • - sell pages
  • - categories list pages - uncomment to disallow
  • Disallow: /categories/
  • Uncomment if you do not wish to allow Google and Bing to index your images
  • User-agent: Googlebot-Image
  • Disallow: /
  • User-agent: msnbot-media
  • Disallow: /
  • Disallow: /*.php$