lommelegen.no
robots.txt
Robots Exclusion Standard data for lommelegen.no
Resource Scan
Scan Details
Site Domain | lommelegen.no |
Base Domain | lommelegen.no |
Scan Status | Ok |
Last Scan | 2024-05-11T04:05:15+00:00 |
Next Scan | 2024-05-18T04:05:15+00:00 |
Last Scan
Scanned | 2024-05-11T04:05:15+00:00 |
URL | https://lommelegen.no/robots.txt |
Redirect | https://lommelegen.dagbladet.no/robots.txt |
Redirect Domain | lommelegen.dagbladet.no |
Redirect Base | dagbladet.no |
Domain IPs | 2a02:c0:ac:3:db::180, 2a02:c0:ac:3:db::181, 2a02:c0:ac:3:db::182, 87.238.33.180, 87.238.33.181, 87.238.33.182 |
Redirect IPs | 104.18.34.161, 172.64.153.95, 2606:4700:4400::6812:22a1, 2606:4700:4400::ac40:995f |
Response IP | 172.64.153.95 |
Found | Yes |
Hash | bcb20a7abaf26b0b5d038a1f47b23f4cdd78e9285d56112e9890360218107c15 |
SimHash | 1b0e8961a137 |
Groups
*
Rule | Path |
---|---|
Disallow | /youtube-player/ |
Disallow | /video/playlist/ |
Disallow | /video/popular/ |
Disallow | /video/* |
Allow | /app/cyclops-router-api/api/v1/ |
Allow | /video/*/* |
Other Records
Field | Value |
---|---|
sitemap | https://lommelegen.dagbladet.no/sitemapindex.xml |