branchenbuch24.com
robots.txt
Robots Exclusion Standard data for branchenbuch24.com
Resource Scan
Scan Details
Site Domain | branchenbuch24.com |
Base Domain | branchenbuch24.com |
Scan Status | Ok |
Last Scan | 2024-09-25T04:18:49+00:00 |
Next Scan | 2024-10-02T04:18:49+00:00 |
Last Scan
Scanned | 2024-09-25T04:18:49+00:00 |
URL | https://branchenbuch24.com/robots.txt |
Redirect | https://www.branchenbuch24.com/robots.txt |
Redirect Domain | www.branchenbuch24.com |
Redirect Base | branchenbuch24.com |
Domain IPs | 5.9.212.231 |
Redirect IPs | 5.9.212.231 |
Response IP | 5.9.212.231 |
Found | Yes |
Hash | aafc1fdcc3b0e0ca1f7c6f512c97fe4beda423e7d16d7af044929b235b3fc1a4 |
SimHash | 6bf0fa829134 |
Groups
*
Rule | Path |
---|---|
Disallow | /suche.html |
Disallow | /suche.html* |
Disallow | /homepage.php |
Disallow | /homepage.php* |
Disallow | /eintrag-loeschen/ |
Disallow | /eintrag-loeschen/* |
Disallow | /eintrag-bearbeiten/ |
Disallow | /eintrag-bearbeiten/* |
Disallow | /ads.html |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
googlebot-image
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |
msnbot-media
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |
psbot
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |
magpie-crawler
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |
yandeximages
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |
yandexmedia
Rule | Path |
---|---|
Disallow | /qrcache/ |
Disallow | /qrcache/* |
Disallow | /images/filmplakate/ |
Disallow | /images/filmplakate/* |
Disallow | /images/logos/ |
Disallow | /images/logos/* |