rabattkoder.tv2.no
robots.txt

Robots Exclusion Standard data for rabattkoder.tv2.no

Resource Scan

Scan Details

Site Domain rabattkoder.tv2.no
Base Domain tv2.no
Scan Status Ok
Last Scan2024-11-03T10:37:12+00:00
Next Scan 2024-12-03T10:37:12+00:00

Last Scan

Scanned2024-11-03T10:37:12+00:00
URL https://rabattkoder.tv2.no/robots.txt
Domain IPs 13.33.30.124, 13.33.30.58, 13.33.30.63, 13.33.30.77
Response IP 13.33.30.124
Found Yes
Hash cfec40760295fffc20ede57ef1a8eaa32200cee3bf31abf7fe213fd265250723
SimHash 5b0c4b4762b2

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /loading/*
Disallow /mercury/out*
Disallow /clickout/*
Disallow /user/submit
Disallow /*?preview

perplexitybot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

seekr

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://rabattkoder.tv2.no/sitemap.xml