Log In Sign Up

stuttgarter-tierschutz.de
robots.txt

Robots Exclusion Standard data for stuttgarter-tierschutz.de

Resource Scan

Scan Details

Site Domain stuttgarter-tierschutz.de
Base Domain stuttgarter-tierschutz.de
Scan Status Ok
Last Scan2025-03-16T18:20:33+00:00
Next Scan 2025-04-15T18:20:33+00:00

Last Scan

Scanned2025-03-16T18:20:33+00:00
URL https://stuttgarter-tierschutz.de/robots.txt
Domain IPs 217.160.0.109
Response IP 217.160.0.109
Found Yes
Hash 2c5d146829aec34843ed16889b9c91d9d4c14b66be4d9984e68befd4a49a97b9
SimHash 9b4e94ca0db1

Groups

*

Rule Path
Disallow /__navi/
Disallow /__old/
Disallow /__statistik/
Disallow /admin/
Disallow /php/
Disallow /tiny_mce/
Disallow /tools/
Disallow /listen/

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://stuttgarter-tierschutz.de/sitemap.xml
Back to top

Comments

  • robots.txt für TSV Stuttgart
  • Diese Datei gibt an, welche Unterverzeichnisse NICHT durch
  • Crawler (Spider, Robots, etc...) durchsucht werden sollen!
  • Alle Robots ausschließen
  • Kompletter Ausschluß
  • XML Sitemap
Back to top