net-vpn.me
robots.txt

Robots Exclusion Standard data for net-vpn.me

Resource Scan

Scan Details

Site Domain net-vpn.me
Base Domain net-vpn.me
Scan Status Ok
Last Scan2026-02-14T23:51:52+00:00
Next Scan 2026-03-16T23:51:52+00:00

Last Scan

Scanned2026-02-14T23:51:52+00:00
URL https://net-vpn.me/robots.txt
Domain IPs 104.21.89.73, 172.67.156.243, 2606:4700:3031::6815:5949, 2606:4700:3031::ac43:9cf3
Response IP 104.21.89.73
Found Yes
Hash 787d8c3b0f71e860ef4bced5dede1af154aef4ca048832ec857264436d3d46a4
SimHash 2d0459400fd3

Groups

*

Rule Path
Allow /lite
Allow /features
Allow /how-it-works
Allow /about-us
Allow /privacy-policy
Allow /terms
Allow /download
Disallow /*.php$
Disallow /*.cgi$
Disallow /*.xmlrpc$
Disallow /*?*

Other Records

Field Value
sitemap https://net-vpn.me/sitemap.xml

Comments

  • robots.txt for https://net-vpn.me/
  • Allow main public pages
  • Disallow specific file types from being crawled