Log In Sign Up

versioneye.com
robots.txt

Robots Exclusion Standard data for versioneye.com

Resource Scan

Scan Details

Site Domain versioneye.com
Base Domain versioneye.com
Scan Status Ok
Last Scan2024-11-18T20:50:58+00:00
Next Scan 2024-12-18T20:50:58+00:00

Last Scan

Scanned2024-11-18T20:50:58+00:00
URL https://versioneye.com/robots.txt
Domain IPs 164.90.240.156
Response IP 164.90.240.156
Found Yes
Hash 3534102b4f64ac5f941f26667e86ded742d31bed3b08eba2f19b6dc250161c8e
SimHash 92cd4d85e445

Groups

*

Rule Path
Disallow /package/
Disallow /package_visual/
Disallow /user/packages/i_follow
Disallow /user/projects/
Disallow /api/v2/
Disallow /api/v1/
Disallow badge$
Disallow /*badge.svg
Disallow /com.*
Disallow /org.*
Disallow /*.json$
Disallow /*.json?*$
Disallow /*.txt$
Disallow /licenses/
Disallow /*.LICENSE$
Disallow /*.LICENSE.txt$
Disallow /*.LICENSE-MIT$
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
  • User-agent: ia_archiver
  • Disallow: /
Back to top