Log In Sign Up

netlib.org
robots.txt

Robots Exclusion Standard data for netlib.org

Resource Scan

Scan Details

Site Domain netlib.org
Base Domain netlib.org
Scan Status Ok
Last Scan2025-02-23T05:10:31+00:00
Next Scan 2025-03-25T05:10:31+00:00

Last Scan

Scanned2025-02-23T05:10:31+00:00
URL https://netlib.org/robots.txt
Domain IPs 160.36.239.231
Response IP 160.36.239.231
Found Yes
Hash 16c061db602e85cbc5b52239dd104704eb8be132cb27fac6f1da8499f4de6374
SimHash 25211f5c1f56

Groups

momspider

Product Comment
momspider The Multi-Owner Maintenance Spider
Rule Path Comment
Disallow /cgi-bin/ Script files
Disallow /confdb/ conferences database

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Back to top

Comments

  • robots.txt for http://www.netlib.org/
  • see <http://web.nexor.co.uk/mak/doc/robots/norobots.html>
  • for an explanation.
Back to top