bergtuftpus.com
robots.txt
Robots Exclusion Standard data for bergtuftpus.com
Resource Scan
Scan Details
| Site Domain | bergtuftpus.com |
| Base Domain | bergtuftpus.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-11-18T06:48:31+00:00 |
| Next Scan | 2026-02-16T06:48:31+00:00 |
Last Successful Scan
| Scanned | 2021-09-02T15:14:51+00:00 |
| URL | http://bergtuftpus.com/robots.txt |
| Found | Yes |
| Hash | b873ad61148af97a5662863c75e7a6cd329a6dd578571b30a2de32a7b67100f3 |
| SimHash | 6c075840c49a |
Groups
Warnings
- 2 invalid lines.
- `crawl-delay` is not a known field.
- `request-rate` is not a known field.