caldera-de-taburiente.de
robots.txt

Robots Exclusion Standard data for caldera-de-taburiente.de

Resource Scan

Scan Details

Site Domain caldera-de-taburiente.de
Base Domain caldera-de-taburiente.de
Scan Status Ok
Last Scan2026-02-16T02:30:44+00:00
Next Scan 2026-02-23T02:30:44+00:00

Last Scan

Scanned2026-02-16T02:30:44+00:00
URL https://caldera-de-taburiente.de/robots.txt
Redirect https://www.caldera-de-taburiente.de/robots.txt
Redirect Domain www.caldera-de-taburiente.de
Redirect Base caldera-de-taburiente.de
Domain IPs 195.252.129.130
Redirect IPs 195.252.129.130
Response IP 195.252.129.130
Found Yes
Hash 4959ca2eaff79f3ac14526a56666f6a35bd68a6d3a16e1b5b8c751d7fd03c96f
SimHash 4e6c10a80172

Groups

*

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /concrete
Disallow /concrete/
Disallow /concrete/images
Disallow /concrete/images/
Disallow /packages
Disallow /packages/
Disallow /mailto*

stress-agent

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

Comments

  • Bad robots