tv2.no
robots.txt
Robots Exclusion Standard data for tv2.no
Resource Scan
Scan Details
| Site Domain | tv2.no |
| Base Domain | tv2.no |
| Scan Status | Ok |
| Last Scan | 2024-05-01T04:54:21+00:00 |
| Next Scan | 2024-05-08T04:54:21+00:00 |
Last Scan
| Scanned | 2024-05-01T04:54:21+00:00 |
| URL | https://tv2.no/robots.txt |
| Redirect | https://www.tv2.no/robots.txt |
| Redirect Domain | www.tv2.no |
| Redirect Base | tv2.no |
| Domain IPs | 5.44.65.150 |
| Redirect IPs | 5.44.65.150 |
| Response IP | 5.44.65.150 |
| Found | Yes |
| Hash | 955a316d692f14ce5069de8f1e9412b1bd52e6f35142dcdf56d7e8cda0526f53 |
| SimHash | 7804c844beb6 |
Groups
rogerbot
gptbot
chatgpt-user
anthropic-ai
claudebot
claude-web
perplexitybot
omgili
omgilibot
bytespider
cohere-ai
ccbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /5374/ |
| Disallow | /TV2/ |
| Disallow | /TV2stream/ |
| Disallow | /backend/ |
| Disallow | /beta/ |
| Disallow | /vaer-beta/ |
| Disallow | /snartlive/ |
| Disallow | /livesport/book/ |
| Disallow | /cache/ |
| Disallow | /do/ |
| Disallow | /dyn-TV2 |
| Disallow | /multimedia/ |
| Disallow | /player/ |
| Disallow | /preview/ |
| Disallow | /rest/ |
| Disallow | /v/test/ |
| Disallow | /arkiv/ajax-api/ |
| Disallow | /arkiv/_relatedArticles |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tv2.no/sitemap/news/sitemap.xml |
| sitemap | https://www.tv2.no/sitemap/sitemap.xml |
| sitemap | https://www.tv2.no/video/api/sitemap |