navsource.net
robots.txt

Robots Exclusion Standard data for navsource.net

Resource Scan

Scan Details

Site Domain navsource.net
Base Domain navsource.net
Scan Status Ok
Last Scan2026-01-14T09:34:12+00:00
Next Scan 2026-02-13T09:34:12+00:00

Last Scan

Scanned2026-01-14T09:34:12+00:00
URL https://navsource.net/robots.txt
Domain IPs 162.241.225.30
Response IP 162.241.225.30
Found Yes
Hash b37525af509287408dc62d98d78622ad46114735ddb0aa6e2bb3b0ca1925f889
SimHash a2038a208073

Groups

*

Product Comment
* direct all spiders
Rule Path
Disallow /mychat/
Disallow /cgi/
Disallow /zips/

roverbot

Rule Path
Disallow /

acme.spider

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

teleport pro/1.2

Rule Path
Disallow /

offline explorer/1.

Rule Path
Disallow /

webstripper/1.41

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /