borgnet.us
robots.txt
Robots Exclusion Standard data for borgnet.us
Resource Scan
Scan Details
Site Domain | borgnet.us |
Base Domain | borgnet.us |
Scan Status | Ok |
Last Scan | 2025-10-12T12:43:06+00:00 |
Next Scan | 2025-10-19T12:43:06+00:00 |
Last Scan
Scanned | 2025-10-12T12:43:06+00:00 |
URL | https://borgnet.us/robots.txt |
Domain IPs | 104.21.82.240, 172.67.209.75, 2606:4700:3031::ac43:d14b, 2606:4700:3037::6815:52f0 |
Response IP | 172.67.209.75 |
Found | Yes |
Hash | defb42e8885a97e2bef98681e05cd819e21c121d07f4ac2b4a88f9e54d9a4d48 |
SimHash | 44354b53c5d5 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Other Records
Field | Value |
---|---|
sitemap | https://borgnet.us/sitemap.xml |
Warnings
- `content-signal` is not a known field.
Comments