tisoomi.deine-tierwelt.de
robots.txt

Robots Exclusion Standard data for tisoomi.deine-tierwelt.de

Resource Scan

Scan Details

Site Domain tisoomi.deine-tierwelt.de
Base Domain deine-tierwelt.de
Scan Status Ok
Last Scan2024-05-24T03:50:57+00:00
Next Scan 2024-05-31T03:50:57+00:00

Last Scan

Scanned2024-05-24T03:50:57+00:00
URL https://tisoomi.deine-tierwelt.de/robots.txt
Redirect https://www.deine-tierwelt.de/robots.txt
Redirect Domain www.deine-tierwelt.de
Redirect Base deine-tierwelt.de
Domain IPs 3.163.24.126, 3.163.24.55, 3.163.24.60, 3.163.24.71
Redirect IPs 18.172.170.28, 18.172.170.32, 18.172.170.51, 18.172.170.57
Response IP 108.157.52.87
Found Yes
Hash b99a9d25e3ebe8bd642c6ed11f2b685306961059af4ddc522fff497548187307
SimHash 2d61d0f3d7b1

Groups

*

Rule Path
Allow /ads.txt
Disallow /

googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
mediapartners (googlebot)
adsbot-google
feedfetcher-google
ia_archiver
bingbot
heritrix
msnbot
slurp
gumgum
teoma
ebay relevance ad crawler
ebay relevance ad crawler powered by contentdetection (www.mindup.de)
browsershots
twitterbot
termlabs
ahrefssiteaudit
facebookexternalhit
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1
facebookcatalog/1.0

Rule Path
Allow /
Disallow /feed/
Disallow /holder-template/
Disallow /ajax/

grapeshot

Rule Path
Disallow

Comments

  • robots.txt fuer www.deine-tierwelt.de
  • [siehe http://selfhtml.teamone.de/diverses/robots.htm]
  • Verzeichnisse bitte unten eintragen:
  • Allgemein
  • Speziell

Warnings

  • `mozilla/5.0 (compatible; facebookbot/1.0; +https` is not a known field.