bitref.xyz
robots.txt
Robots Exclusion Standard data for bitref.xyz
Resource Scan
Scan Details
Site Domain | bitref.xyz |
Base Domain | bitref.xyz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-10T09:38:27+00:00 |
Next Scan | 2024-12-09T09:38:27+00:00 |
Last Successful Scan
Scanned | 2024-04-20T23:29:42+00:00 |
URL | https://bitref.xyz/robots.txt |
Domain IPs | 104.21.48.27, 172.67.176.35, 2606:4700:3034::ac43:b023, 2606:4700:3035::6815:301b |
Response IP | 104.21.48.27 |
Found | Yes |
Hash | 9ec959fc4a508429bcbaf0bd7e3f6087b61e3e067eb85844045e4b9517bc0423 |
SimHash | be4b7a464d51 |