Log In Sign Up

silo8.ch
robots.txt

Robots Exclusion Standard data for silo8.ch

Resource Scan

Scan Details

Site Domain silo8.ch
Base Domain silo8.ch
Scan Status Ok
Last Scan2025-03-23T01:07:41+00:00
Next Scan 2025-04-22T01:07:41+00:00

Last Scan

Scanned2025-03-23T01:07:41+00:00
URL https://silo8.ch/robots.txt
Redirect https://www.silo8.ch/robots.txt
Redirect Domain www.silo8.ch
Redirect Base silo8.ch
Domain IPs 80.74.128.5
Redirect IPs 80.74.128.5
Response IP 80.74.128.5
Found Yes
Hash 6b5a343bce9f051df2584138c8f69921b911cd2b5c2207c0ef19f6cc932f550d
SimHash 295028828fda

Groups

*

Rule Path
Disallow /cgi-bin/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.silo8.ch/sitemap.txt
Back to top

Comments

  • temporär: alle auf disallow setzen
  • User-agent: *
  • Disallow: /
  • LIVE:
  • Ordner ausschliessen
  • Spider komplett ausschliessen
Back to top