bit.do
robots.txt
Robots Exclusion Standard data for bit.do
Resource Scan
Scan Details
Site Domain | bit.do |
Base Domain | bit.do |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-25T06:26:48+00:00 |
Next Scan | 2024-11-23T06:26:48+00:00 |
Last Successful Scan
Scanned | 2023-02-02T07:40:14+00:00 |
URL | https://bit.do/robots.txt |
Domain IPs | 23.21.31.78 |
Response IP | 23.21.31.78 |
Found | Yes |
Hash | b518a5dabf7c949a472602717ab61d7ad06e04bc604a4a6be8a634e5b989003e |
SimHash | c41441444b12 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /mod_perl |
Disallow | /logs/ |
Disallow | /test_ |
Disallow | /api/ |