Log In Sign Up

linsensuppe.de
robots.txt

Robots Exclusion Standard data for linsensuppe.de

Resource Scan

Scan Details

Site Domain linsensuppe.de
Base Domain linsensuppe.de
Scan Status Ok
Last Scan2025-10-16T10:11:39+00:00
Next Scan 2025-11-15T10:11:39+00:00

Last Scan

Scanned2025-10-16T10:11:39+00:00
URL https://linsensuppe.de/robots.txt
Domain IPs 194.6.209.76
Response IP 194.6.209.76
Found Yes
Hash 390313b9a854c41a46e4c83ba86c2e724768fc55b533b24972153b0db2ea515a
SimHash 011c78008557

Groups

googlebot
yahoobot
bingbot
microsoftbot

Rule Path
Disallow /compare
Disallow /checkout
Disallow /register
Disallow /account
Disallow /address
Disallow /note
Disallow /widgets
Disallow /listing
Disallow /ticket

googlebot-image
yahoo-mmcrawler
psbot
teoma
yandex
exabot
gigabot
ia_archiver
baiduspider
nutch
cityreview
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.linsensuppe.de/sitemap.xml
Back to top

Comments

  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================
Back to top