bytebucket.org
robots.txt
Robots Exclusion Standard data for bytebucket.org
Resource Scan
Scan Details
| Site Domain | bytebucket.org |
| Base Domain | bytebucket.org |
| Scan Status | Ok |
| Last Scan | 2024-11-03T21:43:11+00:00 |
| Next Scan | 2024-11-17T21:43:11+00:00 |
Last Scan
| Scanned | 2024-11-03T21:43:11+00:00 |
| URL | https://bytebucket.org/robots.txt |
| Domain IPs | 13.200.41.134, 13.200.41.135, 13.200.41.136, 2401:1d80:322c:2:0:bbc:1:df7c, 2401:1d80:322c:3:0:bbc:1:df7c, 2401:1d80:322c:5:0:bbc:1:df7c |
| Response IP | 104.192.143.21 |
| Found | Yes |
| Hash | e6c5518c143fdd32bc27b2823e545f43e683e9d4fce5afa90092587ad669eab0 |
| SimHash | d57edaaac8e4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /%21api/ |
| Disallow | /*/changesets/ |
| Disallow | /*/changeset/ |
| Disallow | /*/commits/ |
| Disallow | /*/full-commit/ |
| Disallow | /*/annotate/ |
| Disallow | /*/history/ |
| Disallow | /*/follow/ |
| Disallow | /*/get/* |
| Disallow | /*/diff/ |
| Disallow | /*/search/ |
| Disallow | /*/fork/ |
| Disallow | /*/pull/ |
| Disallow | /*/hack/ |
| Disallow | /*/raw/* |
| Disallow | /*.diff$ |
| Disallow | /news/*/$ |
| Disallow | /*/zealots/ |
| Disallow | /*/descendants/ |
| Disallow | /*?status= |
| Disallow | /*?reported_by= |
| Disallow | /*?kind= |
| Disallow | /*?q= |
| Disallow | /*?name= |
| Disallow | /*?receiver= |
| Disallow | /xhr/* |
| Disallow | /*/atom/ |
| Disallow | /*/rss/ |
| Disallow | /*/compare/* |
| Disallow | /*/src/* |
| Disallow | /*/history-node/* |
| Disallow | /jerkstore/* |
| Disallow | /npln/* |
| Disallow | /repo/create |
| Disallow | /dashboard/overview |
| Disallow | /account/password/reset/ |
Warnings
- 2 invalid lines.
Comments