addefend.deine-tierwelt.de
robots.txt
Robots Exclusion Standard data for addefend.deine-tierwelt.de
Resource Scan
Scan Details
| Site Domain | addefend.deine-tierwelt.de |
| Base Domain | deine-tierwelt.de |
| Scan Status | Ok |
| Last Scan | 2024-05-15T04:57:27+00:00 |
| Next Scan | 2024-05-22T04:57:27+00:00 |
Last Scan
| Scanned | 2024-05-15T04:57:27+00:00 |
| URL | https://addefend.deine-tierwelt.de/robots.txt |
| Redirect | https://www.deine-tierwelt.de/robots.txt |
| Redirect Domain | www.deine-tierwelt.de |
| Redirect Base | deine-tierwelt.de |
| Domain IPs | 13.226.2.108, 13.226.2.30, 13.226.2.61, 13.226.2.94 |
| Redirect IPs | 18.164.154.11, 18.164.154.112, 18.164.154.117, 18.164.154.69 |
| Response IP | 3.160.246.90 |
| Found | Yes |
| Hash | b99a9d25e3ebe8bd642c6ed11f2b685306961059af4ddc522fff497548187307 |
| SimHash | 2d61d0f3d7b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Disallow | / |
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
mediapartners (googlebot)
adsbot-google
feedfetcher-google
ia_archiver
bingbot
heritrix
msnbot
slurp
gumgum
teoma
ebay relevance ad crawler
ebay relevance ad crawler powered by contentdetection (www.mindup.de)
browsershots
twitterbot
termlabs
ahrefssiteaudit
facebookexternalhit
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1
facebookcatalog/1.0
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /feed/ |
| Disallow | /holder-template/ |
| Disallow | /ajax/ |
Warnings
- `mozilla/5.0 (compatible; facebookbot/1.0; +https` is not a known field.
Comments