projects.blender.org
robots.txt
Robots Exclusion Standard data for projects.blender.org
Resource Scan
Scan Details
| Site Domain | projects.blender.org |
| Base Domain | blender.org |
| Scan Status | Ok |
| Last Scan | 2024-11-17T08:00:28+00:00 |
| Next Scan | 2024-12-01T08:00:28+00:00 |
Last Scan
| Scanned | 2024-11-17T08:00:28+00:00 |
| URL | https://projects.blender.org/robots.txt |
| Domain IPs | 82.94.226.107 |
| Response IP | 82.94.226.107 |
| Found | Yes |
| Hash | d8c7088dbff9625fdaac5e7c8ffc5a396fe592ac9cfe0403c4e397fcf3991627 |
| SimHash | c0b80903ee90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/* |
| Disallow | /avatars |
| Disallow | /user/* |
| Disallow | /*/*/src/commit/* |
| Disallow | /*/*/commit/* |
| Disallow | /*/*/*/refs/* |
| Disallow | /*/*/*/star |
| Disallow | /*/*/*/watch |
| Disallow | /*/*/labels |
| Disallow | /*/*/activity/* |
| Disallow | /vendor/* |
| Disallow | /swagger.*.json |
| Disallow | /*/*/src/branch/* |
| Disallow | /*/*/rss/branch/* |
| Disallow | /*?lang= |
| Allow | /*/*/tree/master |
| Allow | /*/*/blob/master |
| Disallow | /*/*/pulse |
| Disallow | /*/*/tree/* |
| Disallow | /*/*/blob/* |
| Disallow | /*/*/wiki/*/* |
| Disallow | /gist/*/*/* |
| Disallow | /oembed |
| Disallow | /*/forks |
| Disallow | /*/stars |
| Disallow | /*/download |
| Disallow | /*/revisions |
| Disallow | /*/*/issues/new |
| Disallow | /*/*/issues/search |
| Disallow | /*/*/commits/*/* |
| Disallow | /*/*/commits/*?author |
| Disallow | /*/*/commits/*?path |
| Disallow | /*/*/branches |
| Disallow | /*/*/tags |
| Disallow | /*/*/contributors |
| Disallow | /*/*/comments |
| Disallow | /*/*/stargazers |
| Disallow | /*/*/search |
| Disallow | /*/tarball/ |
| Disallow | /*/zipball/ |
| Disallow | /*/*/archive/ |
| Disallow | /*/*/archive/* |
| Disallow | /raw/* |
| Disallow | /*/followers |
| Disallow | /*/following |
| Disallow | /stars/* |
| Disallow | /*/blame/ |
| Disallow | /*/watchers |
| Disallow | /*/network |
| Disallow | /*/graphs |
| Disallow | /*/raw/ |
| Disallow | /*/compare/ |
| Disallow | /*/cache/ |
| Disallow | /*/*/blame/ |
| Disallow | /*/*/watchers |
| Disallow | /*/*/network |
| Disallow | /*/*/graphs |
| Disallow | /*/*/raw/ |
| Disallow | /*/*/compare/ |
| Disallow | /*/*/cache/ |
| Disallow | /.git/ |
| Disallow | /*/.git/ |
| Disallow | /*.git$ |
| Disallow | /*/sitemap.xml |
| Disallow | /search/advanced |
| Disallow | /search |
| Disallow | /*q%3D |
| Disallow | /*.atom |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Comments