fiskeribladet.no
robots.txt
Robots Exclusion Standard data for fiskeribladet.no
Resource Scan
Scan Details
| Site Domain | fiskeribladet.no |
| Base Domain | fiskeribladet.no |
| Scan Status | Ok |
| Last Scan | 2024-11-14T14:53:42+00:00 |
| Next Scan | 2024-11-21T14:53:42+00:00 |
Last Scan
| Scanned | 2024-11-14T14:53:42+00:00 |
| URL | https://fiskeribladet.no/robots.txt |
| Redirect | https://www.fiskeribladet.no/robots.txt |
| Redirect Domain | www.fiskeribladet.no |
| Redirect Base | fiskeribladet.no |
| Domain IPs | 87.238.33.146 |
| Redirect IPs | 3.165.82.15, 3.165.82.39, 3.165.82.42, 3.165.82.50 |
| Response IP | 3.165.82.50 |
| Found | Yes |
| Hash | 9acc5a0ab7fedb49a9131152e43384e992518a5bc25220b3084f8b25fa955750 |
| SimHash | 295f1897ce97 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forgotpw/* |
*
| Rule | Path |
|---|---|
| Disallow | /auth/user/login/* |
*
| Rule | Path |
|---|---|
| Disallow | /myprofile/* |
*
| Rule | Path |
|---|---|
| Disallow | /subscription/* |
*
| Rule | Path |
|---|---|
| Disallow | /test_frontpage |
*
| Rule | Path |
|---|---|
| Disallow | /front |
*
| Rule | Path |
|---|---|
| Disallow | /annonsorinnhold* |
*
| Rule | Path |
|---|---|
| Disallow | /sponsor-content* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fiskeribladet.no/sitemap.xml |