avisen.dk
robots.txt
Robots Exclusion Standard data for avisen.dk
Resource Scan
Scan Details
| Site Domain | avisen.dk |
| Base Domain | avisen.dk |
| Scan Status | Ok |
| Last Scan | 2024-11-12T23:55:13+00:00 |
| Next Scan | 2024-11-19T23:55:13+00:00 |
Last Scan
| Scanned | 2024-11-12T23:55:13+00:00 |
| URL | https://avisen.dk/robots.txt |
| Redirect | https://www.avisen.dk/robots.txt |
| Redirect Domain | www.avisen.dk |
| Redirect Base | avisen.dk |
| Domain IPs | 104.21.6.171, 172.67.135.15, 2606:4700:3034::6815:6ab, 2606:4700:3035::ac43:870f |
| Redirect IPs | 104.21.6.171, 172.67.135.15, 2606:4700:3034::6815:6ab, 2606:4700:3035::ac43:870f |
| Response IP | 172.67.135.15 |
| Found | Yes |
| Hash | a087908b5cdd51e14da935baade9b0489bdd8310cd20861c3aadbe0e1ea0af95 |
| SimHash | 2004da50c753 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tu_* |
| Disallow | /edit/ |
| Disallow | /Edit/ |
| Disallow | /errors/ |
| Disallow | /Errors/ |
| Disallow | /handlers/ |
| Disallow | /Handlers/ |
| Disallow | /5195128/ |
| Disallow | /jobhaandbog/emner/ |
| Disallow | /controlpanel/ |
| Disallow | /arkiv/ |
| Disallow | /utility/ |
| Disallow | /photos/ |
| Disallow | /touch |
| Disallow | /touch/ |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.avisen.dk/sitemap_index.aspx |