lspace.org
robots.txt

Robots Exclusion Standard data for lspace.org

Resource Scan

Scan Details

Site Domain lspace.org
Base Domain lspace.org
Scan Status Ok
Last Scan2024-05-22T20:08:23+00:00
Next Scan 2024-06-21T20:08:23+00:00

Last Scan

Scanned2024-05-22T20:08:23+00:00
URL https://www.lspace.org/robots.txt
Domain IPs 2404:6800:4003:c11::79, 74.125.200.121
Response IP 74.125.68.121
Found Yes
Hash e6881d372dddbe28de74314bc9717e5cbf2d9bf23a2992a41abe6c6e7da766b5
SimHash a0246908bf84

Groups

*

Rule Path
Disallow /site-specific

Comments

  • L-Space mirrors welcome all robots and webcrawling beasties.
  • There's no need to crawl the site-specific pages, though: