wohnenmietenkaufen.de
robots.txt
Robots Exclusion Standard data for wohnenmietenkaufen.de
Resource Scan
Scan Details
| Site Domain | wohnenmietenkaufen.de |
| Base Domain | wohnenmietenkaufen.de |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-25T08:25:34+00:00 |
| Next Scan | 2024-11-23T08:25:34+00:00 |
Last Successful Scan
| Scanned | 2024-01-29T08:24:05+00:00 |
| URL | https://wohnenmietenkaufen.de/robots.txt |
| Domain IPs | 5.9.212.237 |
| Response IP | 5.9.212.237 |
| Found | Yes |
| Hash | a86cd3942b97a80be2770d9fc155be8d4ee93bbab6a1a7de4d996a3e94143bcf |
| SimHash | 6fa8f8948ed5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redirect.php |
| Disallow | /cgi-bin/ |
| Disallow | /_vti_bin/ |
| Disallow | /MSOffice/ |
| Disallow | /mietrecht/ |
| Disallow | /suche.php? |
| Disallow | /Suche-abonnieren/ |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |
psbot
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |
magpie-crawler
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |
yandeximages
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |
yandexmedia
| Rule | Path |
|---|---|
| Disallow | /attachments/ |
| Disallow | /attachments/* |
| Disallow | /img/artikel/ |
| Disallow | /img/artikel/* |
| Disallow | /img/quelle/ |
| Disallow | /img/quelle/* |
| Disallow | /img/numcache/ |
| Disallow | /img/numcache/* |