univillage.de
robots.txt
Robots Exclusion Standard data for univillage.de
Resource Scan
Scan Details
| Site Domain | univillage.de |
| Base Domain | univillage.de |
| Scan Status | Ok |
| Last Scan | 2024-09-25T00:05:25+00:00 |
| Next Scan | 2024-10-02T00:05:25+00:00 |
Last Scan
| Scanned | 2024-09-25T00:05:25+00:00 |
| URL | https://univillage.de/robots.txt |
| Domain IPs | 5.9.212.225 |
| Response IP | 5.9.212.225 |
| Found | Yes |
| Hash | e7eb9db6f91ad23d58834bb5486256e802ba3d683902dfc84a0562757d50718c |
| SimHash | 6344f191d3c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redirect.php |
| Disallow | /redirect.php? |
| Disallow | /images/numcache/ |
| Disallow | /artikel_backend/ |
| Disallow | /cache/ |
| Disallow | /buchempfehlung/ |
| Disallow | /homepage.php |
| Disallow | /Musik/ |
| Disallow | /Games/ |
| Disallow | /veranstaltungen/suche.html |
| Disallow | /veranstaltungen/suche.html?s* |
| Disallow | /ads.html |
| Disallow | /agb_ideenkraftwerk_gmbh.pdf |
| Disallow | /agb.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /redirect.php |
| Disallow | /redirect.php? |
| Disallow | /images/numcache/ |
| Disallow | /artikel_backend/ |
| Disallow | /cache/ |
| Disallow | /buchempfehlung/ |
| Disallow | /homepage.php |
| Disallow | /Musik/ |
| Disallow | /Games/ |
| Disallow | /veranstaltungen/suche.html |
| Disallow | /veranstaltungen/suche.html?s* |
| Disallow | /ads.html |
| Disallow | /agb_ideenkraftwerk_gmbh.pdf |
| Disallow | /agb.html |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |
psbot
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |
magpie-crawler
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |
yandeximages
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |
yandexmedia
| Rule | Path |
|---|---|
| Disallow | /images/filmplakate/ |
| Disallow | /images/filmplakate/* |
| Disallow | /qrcache/ |
| Disallow | /qrcache/* |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/ |
| Disallow | /stellenanzeigen-inserieren/firmenlogos/* |
| Disallow | /images/artikel/ |
| Disallow | /images/artikel/* |