tisoomi.deine-tierwelt.de
robots.txt
Robots Exclusion Standard data for tisoomi.deine-tierwelt.de
Resource Scan
Scan Details
Site Domain | tisoomi.deine-tierwelt.de |
Base Domain | deine-tierwelt.de |
Scan Status | Ok |
Last Scan | 2024-05-24T03:50:57+00:00 |
Next Scan | 2024-05-31T03:50:57+00:00 |
Last Scan
Scanned | 2024-05-24T03:50:57+00:00 |
URL | https://tisoomi.deine-tierwelt.de/robots.txt |
Redirect | https://www.deine-tierwelt.de/robots.txt |
Redirect Domain | www.deine-tierwelt.de |
Redirect Base | deine-tierwelt.de |
Domain IPs | 3.163.24.126, 3.163.24.55, 3.163.24.60, 3.163.24.71 |
Redirect IPs | 18.172.170.28, 18.172.170.32, 18.172.170.51, 18.172.170.57 |
Response IP | 108.157.52.87 |
Found | Yes |
Hash | b99a9d25e3ebe8bd642c6ed11f2b685306961059af4ddc522fff497548187307 |
SimHash | 2d61d0f3d7b1 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Disallow | / |
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
mediapartners (googlebot)
adsbot-google
feedfetcher-google
ia_archiver
bingbot
heritrix
msnbot
slurp
gumgum
teoma
ebay relevance ad crawler
ebay relevance ad crawler powered by contentdetection (www.mindup.de)
browsershots
twitterbot
termlabs
ahrefssiteaudit
facebookexternalhit
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1
facebookcatalog/1.0
Rule | Path |
---|---|
Allow | / |
Disallow | /feed/ |
Disallow | /holder-template/ |
Disallow | /ajax/ |
Warnings
- `mozilla/5.0 (compatible; facebookbot/1.0; +https` is not a known field.
Comments