dinside.no
robots.txt
Robots Exclusion Standard data for dinside.no
Resource Scan
Scan Details
| Site Domain | dinside.no |
| Base Domain | dinside.no |
| Scan Status | Ok |
| Last Scan | 2024-09-22T04:01:08+00:00 |
| Next Scan | 2024-09-29T04:01:08+00:00 |
Last Scan
| Scanned | 2024-09-22T04:01:08+00:00 |
| URL | https://dinside.no/robots.txt |
| Redirect | https://dinside.dagbladet.no/robots.txt |
| Redirect Domain | dinside.dagbladet.no |
| Redirect Base | dagbladet.no |
| Domain IPs | 104.18.38.62, 172.64.149.194 |
| Redirect IPs | 104.18.34.161, 172.64.153.95, 2606:4700:4400::6812:22a1, 2606:4700:4400::ac40:995f |
| Response IP | 104.18.34.161 |
| Found | Yes |
| Hash | 4e92e6d5d925dc64ce13d3037cb6008c3482cb5a7a2599c560bf4a981f82dcfd |
| SimHash | 501a4951c115 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /youtube-player/ |
| Disallow | /video/playlist/ |
| Disallow | /video/popular/ |
| Disallow | /video/* |
| Disallow | /app/* |
| Allow | /app/cyclops-router-api/api/v1/ |
| Allow | /app/jw-api-proxy/sitemap/index/dinside.xml |
| Allow | /video/*/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dinside.dagbladet.no/sitemapindex.xml |
| sitemap | https://dinside.dagbladet.no/app/jw-api-proxy/sitemap/index/dinside.xml |