git.skrubzilla.com
robots.txt
Robots Exclusion Standard data for git.skrubzilla.com
Resource Scan
Scan Details
Site Domain | git.skrubzilla.com |
Base Domain | skrubzilla.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-14T21:15:04+00:00 |
Next Scan | 2024-12-13T21:15:04+00:00 |
Last Successful Scan
Scanned | 2022-09-05T21:36:43+00:00 |
URL | https://git.skrubzilla.com/robots.txt |
Response IP | 104.21.28.12 |
Found | Yes |
Hash | 6e281ebbf54733e6c454fc8541c95ea28154a27bb7e9a000765df86dad2a08c2 |
SimHash | c69299536377 |
Groups
*
Rule | Path |
---|---|
Disallow | /autocomplete/users |
Disallow | /autocomplete/projects |
Disallow | /search |
Disallow | /admin |
Disallow | /profile |
Disallow | /dashboard |
Disallow | /users |
Disallow | /api/v* |
Disallow | /help |
Disallow | /s/ |
Disallow | /-/profile |
Disallow | /-/ide/ |
Disallow | /-/experiment |
Allow | /users/sign_in |
Allow | /users/sign_up |
Allow | /users/*/snippets |
*
Rule | Path |
---|---|
Disallow | /*/new |
Disallow | /*/edit |
Disallow | /*/raw |
Disallow | /*/realtime_changes |
*
Rule | Path |
---|---|
Disallow | /groups/*/analytics |
Disallow | /groups/*/contribution_analytics |
Disallow | /groups/*/group_members |
Disallow | /groups/*/-/saml/sso |
*
Rule | Path |
---|---|
Disallow | /*/*.git$ |
Disallow | /*/archive/ |
Disallow | /*/repository/archive* |
Disallow | /*/activity |
Disallow | /*/blame |
Disallow | /*/commits |
Disallow | /*/commit |
Disallow | /*/commit/*.patch |
Disallow | /*/commit/*.diff |
Disallow | /*/compare |
Disallow | /*/network |
Disallow | /*/graphs |
Disallow | /*/merge_requests/*.patch |
Disallow | /*/merge_requests/*.diff |
Disallow | /*/merge_requests/*/diffs |
Disallow | /*/deploy_keys |
Disallow | /*/hooks |
Disallow | /*/services |
Disallow | /*/protected_branches |
Disallow | /*/uploads/ |
Disallow | /*/project_members |
Disallow | /*/settings |
Disallow | /*/-/import |
Disallow | /*/-/environments |
Disallow | /*/-/jobs |
Disallow | /*/-/requirements_management |
Disallow | /*/-/pipelines |
Disallow | /*/-/pipeline_schedules |
Disallow | /*/-/dependencies |
Disallow | /*/-/licenses |
Disallow | /*/-/metrics |
Disallow | /*/-/incidents |
Disallow | /*/-/value_stream_analytics |
Disallow | /*/-/analytics |
Disallow | /*/insights |
Comments