git.asgardius.company
robots.txt
Robots Exclusion Standard data for git.asgardius.company
Resource Scan
Scan Details
| Site Domain | git.asgardius.company |
| Base Domain | asgardius.company |
| Scan Status | Ok |
| Last Scan | 2025-10-22T16:26:38+00:00 |
| Next Scan | 2025-11-05T16:26:38+00:00 |
Last Scan
| Scanned | 2025-10-22T16:26:38+00:00 |
| URL | https://git.asgardius.company/robots.txt |
| Domain IPs | 62.210.209.158 |
| Response IP | 62.210.209.158 |
| Found | Yes |
| Hash | 83e400f6d6889795dc289e78c84681912a5816bed8877aebbd2bd05c4cf26102 |
| SimHash | 1f0c5a0fefc2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /avatars/ |
| Disallow | /user/ |
| Disallow | /swagger.*.json |
| Disallow | /explore/*?* |
| Disallow | /repo/create |
| Disallow | /repo/migrate |
| Disallow | /org/create |
| Disallow | /*/*/fork |
| Disallow | /*/*/watchers |
| Disallow | /*/*/stargazers |
| Disallow | /*/*/forks |
| Disallow | /*/*/src/ |
| Disallow | /*/*/blame/ |
| Disallow | /*/*/commit/ |
| Disallow | /*/*/commits/ |
| Disallow | /*/*/raw/ |
| Disallow | /*/*/media/ |
| Disallow | /*/*/tags |
| Disallow | /*/*/graph |
| Disallow | /*/*/branches |
| Disallow | /*/*/compare |
| Disallow | /*/*/lastcommit/ |
| Disallow | /*/*/rss/branch/ |
| Disallow | /*/*/atom/branch/ |
| Disallow | /*/*/activity |
| Disallow | /*/*/activity_author_data |
| Disallow | /*/*/actions |
| Disallow | /*/*/projects |
| Disallow | /*/*/labels |
| Disallow | /*/*/milestones |
| Disallow | /*/*/find/ |
| Disallow | /*/*/tree-list/ |
| Disallow | /*/*/search/ |
| Disallow | /*/-/code |
| Disallow | /*/*/issues/new |
| Disallow | /*/*/pulls/*/files |
| Disallow | /*/*/pulls/*/commits |
| Disallow | /attachments/ |
| Disallow | /*/*/attachments/ |
| Disallow | /*/*/issues/*/attachments/ |
| Disallow | /*/*/pulls/*/attachments/ |
| Disallow | /*/*/releases/attachments |
| Disallow | /*/*/releases/download |
| Disallow | /*/*/archive/ |
| Disallow | /*.bundle$ |
| Disallow | /*.patch$ |
| Disallow | /*.diff$ |
| Disallow | /*.atom$ |
| Disallow | /*.rss$ |
| Disallow | /*lang%3D* |
| Disallow | /*redirect_to%3D* |
| Disallow | /*tab%3D* |
| Disallow | /*q%3D* |
| Disallow | /*sort%3D* |
| Disallow | /*repo-search-archived%3D* |
Comments