Log In Sign Up

oldtimerfreunde-mv.de
robots.txt

Robots Exclusion Standard data for oldtimerfreunde-mv.de

Resource Scan

Scan Details

Site Domain oldtimerfreunde-mv.de
Base Domain oldtimerfreunde-mv.de
Scan Status Ok
Last Scan2025-06-18T08:03:31+00:00
Next Scan 2025-07-18T08:03:31+00:00

Last Scan

Scanned2025-06-18T08:03:31+00:00
URL https://oldtimerfreunde-mv.de/robots.txt
Domain IPs 2a01:238:20a:202:1160::, 81.169.145.160
Response IP 81.169.145.160
Found Yes
Hash acd95c97e26fc464daf634726c8d8f769b25690816131dfb0bd1aa1bcc8e397d
SimHash f95958048753

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /temp/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.oldtimerfreunde-mv.de/sitemap.xml
Back to top

Comments

  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schliesse folgende Spider komplett aus:
  • ===================================
Back to top