videolan.org
robots.txt

Robots Exclusion Standard data for videolan.org

Resource Scan

Scan Details

Site Domain videolan.org
Base Domain videolan.org
Scan Status Ok
Last Scan2024-09-20T06:46:00+00:00
Next Scan 2024-09-27T06:46:00+00:00

Last Scan

Scanned2024-09-20T06:46:00+00:00
URL https://videolan.org/robots.txt
Redirect https://www.videolan.org/robots.txt
Redirect Domain www.videolan.org
Redirect Base videolan.org
Domain IPs 213.36.253.2, 2a01:e0d:1:3:58bf:fa02:c0de:5
Redirect IPs 213.36.253.2, 2a01:e0d:1:3:58bf:fa02:c0de:5
Response IP 213.36.253.2
Found Yes
Hash 6aca2b74b6296e344a73f5785ff6f739b00d128108cbf22c146519ce97d8ebe0
SimHash 945de17a6bf1

Groups

*

Rule Path
Disallow /pub
Disallow /removed
Disallow /doc/logs
Disallow /mirror.php
Disallow /mirror-geo.php
Disallow /mirror-geo-redirect.php
Disallow /vlc/download-skins2-go.php
Disallow /private
Disallow /~videolan/
Disallow /developers/vlc/po
Disallow /developers/vlc-branch/po

*

Rule Path
Disallow CVS
Disallow .svn

turnitinbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.videolan.org/sitemap-https.xml

Comments

  • $Id$
  • Do not crawl CVS and .svn directories
  • "This robot collects content from the Internet for the sole purpose of
  • helping educational institutions prevent plagiarism. [...] we compare
  • student papers against the content we find on the Internet to see if we
  • can find similarities." (http://www.turnitin.com/robot/crawlerinfo.html)
  • --> fuck off.
  • "NameProtect engages in crawling activity in search of a wide range of
  • brand and other intellectual property violations that may be of interest
  • to our clients." (http://www.nameprotect.com/botinfo.html)
  • --> fuck off.
  • "iThenticate® is a new service we have developed to combat the piracy
  • of intellectual property and ensure the originality of written work for
  • publishers, non-profit agencies, corporations, and newspapers."
  • (http://www.slysearch.com/)
  • --> fuck off.