tølt.no
robots.txt
Robots Exclusion Standard data for tølt.no
Resource Scan
Scan Details
| Site Domain | tølt.no |
| Base Domain | tølt.no |
| Scan Status | Ok |
| Last Scan | 2025-10-29T09:31:14+00:00 |
| Next Scan | 2025-11-05T09:31:14+00:00 |
Last Scan
| Scanned | 2025-10-29T09:31:14+00:00 |
| URL | https://tølt.no/robots.txt |
| Redirect | https://xn--tlt-0na.no/robots.txt |
| Domain IPs | 95.217.68.68 |
| Response IP | 95.217.68.68 |
| Found | Yes |
| Hash | 87176f66ec580c04e77234d172efa1980defc753f590f68066e7f245c3f31fc1 |
| SimHash | 5816d854f9d0 |
Groups
semrushbot
ahrefsbot
serpstatbot
dataforseobot
mj12bot
sentibot
yandexbot
petalbot
neticle
buck
cookieinformationscanner
trendictionbot
velenpublicwebcrawler
gptbot
oai-searchbot
openai-searchbot
chatgpt-user
ccbot
claudebot
anthropic-ai
claude-web
perplexitybot
perplexity-user
google-extended
googlebot-extended
meta-externalagent
meta-externalfetcher
amazonbot
applebot
applebot-extended
bytespider
cohere-ai
ai2bot
diffbot
youbot
mistralai-user
duckassistbot
timpibot
other
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /webdesk/ |
| Disallow | /search |
| Disallow | /index.php*%26do%3Dsok* |
| Disallow | /api/ |
| Disallow | /conf/ |
| Disallow | /src/lang/ |
| Disallow | /src/nocache/ |
| Disallow | /*download.php |
| Disallow | /src/download.php |
| Disallow | /dashboard.php |
| Disallow | /buyandread/ |
| Disallow | /minside/tipsenvenn/ |
| Disallow | /pageflow/ |
| Disallow | /minside/brukere/ |
| Disallow | /src/lib/blackhole/ |
| Disallow | /*?*ac=* |
| Disallow | /*/ac/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://xn--tlt-0na.no/sitemap.xml |
Comments