git.xeondev.com
robots.txt
Robots Exclusion Standard data for git.xeondev.com
Resource Scan
Scan Details
| Site Domain | git.xeondev.com |
| Base Domain | xeondev.com |
| Scan Status | Ok |
| Last Scan | 2025-10-22T14:58:07+00:00 |
| Next Scan | 2025-11-05T14:58:07+00:00 |
Last Scan
| Scanned | 2025-10-22T14:58:07+00:00 |
| URL | https://git.xeondev.com/robots.txt |
| Domain IPs | 104.21.30.176, 172.67.173.124, 2606:4700:3033::6815:1eb0, 2606:4700:3037::ac43:ad7c |
| Response IP | 172.67.173.124 |
| Found | Yes |
| Hash | 83e400f6d6889795dc289e78c84681912a5816bed8877aebbd2bd05c4cf26102 |
| SimHash | 1f0c5a0fefc2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /avatars/ |
| Disallow | /user/ |
| Disallow | /swagger.*.json |
| Disallow | /explore/*?* |
| Disallow | /repo/create |
| Disallow | /repo/migrate |
| Disallow | /org/create |
| Disallow | /*/*/fork |
| Disallow | /*/*/watchers |
| Disallow | /*/*/stargazers |
| Disallow | /*/*/forks |
| Disallow | /*/*/src/ |
| Disallow | /*/*/blame/ |
| Disallow | /*/*/commit/ |
| Disallow | /*/*/commits/ |
| Disallow | /*/*/raw/ |
| Disallow | /*/*/media/ |
| Disallow | /*/*/tags |
| Disallow | /*/*/graph |
| Disallow | /*/*/branches |
| Disallow | /*/*/compare |
| Disallow | /*/*/lastcommit/ |
| Disallow | /*/*/rss/branch/ |
| Disallow | /*/*/atom/branch/ |
| Disallow | /*/*/activity |
| Disallow | /*/*/activity_author_data |
| Disallow | /*/*/actions |
| Disallow | /*/*/projects |
| Disallow | /*/*/labels |
| Disallow | /*/*/milestones |
| Disallow | /*/*/find/ |
| Disallow | /*/*/tree-list/ |
| Disallow | /*/*/search/ |
| Disallow | /*/-/code |
| Disallow | /*/*/issues/new |
| Disallow | /*/*/pulls/*/files |
| Disallow | /*/*/pulls/*/commits |
| Disallow | /attachments/ |
| Disallow | /*/*/attachments/ |
| Disallow | /*/*/issues/*/attachments/ |
| Disallow | /*/*/pulls/*/attachments/ |
| Disallow | /*/*/releases/attachments |
| Disallow | /*/*/releases/download |
| Disallow | /*/*/archive/ |
| Disallow | /*.bundle$ |
| Disallow | /*.patch$ |
| Disallow | /*.diff$ |
| Disallow | /*.atom$ |
| Disallow | /*.rss$ |
| Disallow | /*lang%3D* |
| Disallow | /*redirect_to%3D* |
| Disallow | /*tab%3D* |
| Disallow | /*q%3D* |
| Disallow | /*sort%3D* |
| Disallow | /*repo-search-archived%3D* |
Comments