startsiden.no
robots.txt
Robots Exclusion Standard data for startsiden.no
Resource Scan
Scan Details
| Site Domain | startsiden.no |
| Base Domain | startsiden.no |
| Scan Status | Ok |
| Last Scan | 2024-11-01T21:36:18+00:00 |
| Next Scan | 2024-11-08T21:36:18+00:00 |
Last Scan
| Scanned | 2024-11-01T21:36:18+00:00 |
| URL | https://startsiden.no/robots.txt |
| Redirect | https://www.startsiden.no/robots.txt |
| Redirect Domain | www.startsiden.no |
| Redirect Base | startsiden.no |
| Domain IPs | 87.238.33.153, 87.238.33.154 |
| Redirect IPs | 87.238.33.153, 87.238.33.154 |
| Response IP | 87.238.33.154 |
| Found | Yes |
| Hash | 0db95983b665d2ba995d0e30e756cfaeec7570685db03110ee678bcfe87beb82 |
| SimHash | 414e12eb07a9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rate.html |
| Disallow | /sok/nyheter/ |
| Disallow | /sok/*?*q= |
| Disallow | /pekertips.html? |
| Disallow | /tvguide/e |
| Disallow | /tvguide/ajax |
| Disallow | /tvguide/channel |
| Disallow | /tvguide/css |
| Disallow | /tvguide/epg |
| Disallow | /tvguide/setup |
| Disallow | /tvguide/xml |
| Disallow | /tvguide/?dag |
| Disallow | /tvguide/?channel |
| Disallow | /tvguide/sok |
| Disallow | /api |
| Disallow | /nettguide/search |
| Disallow | /nettguide/suggest |
| Disallow | /nettguide/catalog |
| Disallow | /nettguide/suggestions |
| Disallow | /nettguide/entities |
| Disallow | /nettguide/autocomplete |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.startsiden.no/sitemap_index.xml |