vesterbro-nyt.dk
robots.txt
Robots Exclusion Standard data for vesterbro-nyt.dk
Resource Scan
Scan Details
| Site Domain | vesterbro-nyt.dk |
| Base Domain | vesterbro-nyt.dk |
| Scan Status | Ok |
| Last Scan | 2024-09-20T09:34:24+00:00 |
| Next Scan | 2024-09-27T09:34:24+00:00 |
Last Scan
| Scanned | 2024-09-20T09:34:24+00:00 |
| URL | http://vesterbro-nyt.dk/robots.txt |
| Domain IPs | 168.119.144.196 |
| Response IP | 168.119.144.196 |
| Found | Yes |
| Hash | 7c22ab12bc5b69056e5c58225b256e28897fcff1b449a9466d53d5381432ddff |
| SimHash | 81209a218414 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /soeg |
| Disallow | /embed |
| Disallow | /galleri |
Warnings
- `http` is not a known field.
Comments