deine-tierwelt.de
robots.txt
Robots Exclusion Standard data for deine-tierwelt.de
Resource Scan
Scan Details
| Site Domain | deine-tierwelt.de |
| Base Domain | deine-tierwelt.de |
| Scan Status | Ok |
| Last Scan | 2024-11-16T16:30:23+00:00 |
| Next Scan | 2024-11-23T16:30:23+00:00 |
Last Scan
| Scanned | 2024-11-16T16:30:23+00:00 |
| URL | https://deine-tierwelt.de/robots.txt |
| Redirect | https://www.deine-tierwelt.de/robots.txt |
| Redirect Domain | www.deine-tierwelt.de |
| Redirect Base | deine-tierwelt.de |
| Domain IPs | 13.226.2.108, 13.226.2.30, 13.226.2.61, 13.226.2.94 |
| Redirect IPs | 3.164.85.129, 3.164.85.27, 3.164.85.82, 3.164.85.95 |
| Response IP | 13.226.2.108 |
| Found | Yes |
| Hash | 97e32bb0b4c34fe404248420da3f18a5af284f8fbee7b0293dddb4528d40401c |
| SimHash | 2909d272d78f |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Disallow | / |
adsbot-google
ahrefssiteaudit
applebot
baiduspider
bingbot
browsershots
duckduckbot
ebay relevance ad crawler
ebay relevance ad crawler powered by contentdetection (www.mindup.de)
mozilla/5.0 (compatible; konqueror/3.5; linux) khtml/3.5.5 (like gecko) (exabot-thumbnails)
mozilla/5.0 (compatible; exabot/3.0; +http://www.exabot.com/go/robot)
facebookcatalog/1.0
facebookexternalhit
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
feedfetcher-google
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
grapeshot
gumgum
heritrix
ia_archiver
linkedinbot
mediapartners-google
mediapartners (googlebot)
msnbot
pinterestbot
slackbot
slurp
sogou
teoma
termlabs
twitterbot
yandexbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /feed/ |
| Disallow | /holder-template/ |
| Disallow | /ajax/ |
| Disallow | /payment/ |
Comments