tgn.no
robots.txt
Robots Exclusion Standard data for tgn.no
Resource Scan
Scan Details
| Site Domain | tgn.no |
| Base Domain | tgn.no |
| Scan Status | Ok |
| Last Scan | 2026-01-20T22:21:03+00:00 |
| Next Scan | 2026-02-03T22:21:03+00:00 |
Last Scan
| Scanned | 2026-01-20T22:21:03+00:00 |
| URL | https://tgn.no/robots.txt |
| Domain IPs | 95.217.68.68 |
| Response IP | 95.217.68.68 |
| Found | Yes |
| Hash | be4251f52df0afcd175dc7f7a8ee933f19c717b95a145961e414f21334d98e35 |
| SimHash | 4816d854f9c0 |
Groups
semrushbot
ahrefsbot
serpstatbot
dataforseobot
mj12bot
sentibot
yandexbot
petalbot
neticle
buck
cookieinformationscanner
trendictionbot
velenpublicwebcrawler
gptbot
oai-searchbot
openai-searchbot
chatgpt-user
ccbot
claudebot
anthropic-ai
claude-web
perplexitybot
perplexity-user
google-extended
googlebot-extended
meta-externalagent
meta-externalfetcher
amazonbot
applebot
applebot-extended
bytespider
cohere-ai
ai2bot
diffbot
youbot
mistralai-user
duckassistbot
timpibot
other
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /webdesk/ |
| Disallow | /search |
| Disallow | /index.php*%26do%3Dsok* |
| Disallow | /api/ |
| Disallow | /conf/ |
| Disallow | /src/lang/ |
| Disallow | /src/nocache/ |
| Disallow | /*download.php |
| Disallow | /src/download.php |
| Disallow | /dashboard.php |
| Disallow | /buyandread/ |
| Disallow | /minside/tipsenvenn/ |
| Disallow | /pageflow/ |
| Disallow | /minside/brukere/ |
| Disallow | /src/lib/blackhole/ |
| Disallow | /*?*ac=* |
| Disallow | /*/ac/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tgn.no/sitemap.xml |
Comments