branchenbuch24.com
robots.txt

Robots Exclusion Standard data for branchenbuch24.com

Resource Scan

Scan Details

Site Domain branchenbuch24.com
Base Domain branchenbuch24.com
Scan Status Ok
Last Scan2024-09-25T04:18:49+00:00
Next Scan 2024-10-02T04:18:49+00:00

Last Scan

Scanned2024-09-25T04:18:49+00:00
URL https://branchenbuch24.com/robots.txt
Redirect https://www.branchenbuch24.com/robots.txt
Redirect Domain www.branchenbuch24.com
Redirect Base branchenbuch24.com
Domain IPs 5.9.212.231
Redirect IPs 5.9.212.231
Response IP 5.9.212.231
Found Yes
Hash aafc1fdcc3b0e0ca1f7c6f512c97fe4beda423e7d16d7af044929b235b3fc1a4
SimHash 6bf0fa829134

Groups

*

Rule Path
Disallow /suche.html
Disallow /suche.html*
Disallow /homepage.php
Disallow /homepage.php*
Disallow /eintrag-loeschen/
Disallow /eintrag-loeschen/*
Disallow /eintrag-bearbeiten/
Disallow /eintrag-bearbeiten/*
Disallow /ads.html

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow

sistrix

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

msnbot-media

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

psbot

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

magpie-crawler

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

yandeximages

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

yandexmedia

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

yahoo-mmcrawler

Rule Path
Disallow /qrcache/
Disallow /qrcache/*
Disallow /images/filmplakate/
Disallow /images/filmplakate/*
Disallow /images/logos/
Disallow /images/logos/*

sistrix

Rule Path
Disallow /

sogou

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1