tølt.no
robots.txt
Robots Exclusion Standard data for tølt.no
Resource Scan
Scan Details
Site Domain | tølt.no |
Base Domain | tølt.no |
Scan Status | Ok |
Last Scan | 2025-06-17T08:17:07+00:00 |
Next Scan | 2025-06-24T08:17:07+00:00 |
Last Scan
Scanned | 2025-06-17T08:17:07+00:00 |
URL | https://tølt.no/robots.txt |
Redirect | https://xn--tlt-0na.no/robots.txt |
Domain IPs | 95.217.68.68 |
Response IP | 95.217.68.68 |
Found | Yes |
Hash | 0580b6d742689abdd247273fbed64e9486f9b388681b92722d2796766c8a07ca |
SimHash | 4b14cc107982 |
Groups
semrushbot
ahrefsbot
serpstatbot
dataforseobot
mj12bot
sentibot
yandexbot
petalbot
neticle
buck
cookieinformationscanner
trendictionbot
velenpublicwebcrawler
other
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /webdesk/ |
Disallow | /search |
Disallow | /index.php*%26do%3Dsok* |
Disallow | /api/ |
Disallow | /conf/ |
Disallow | /src/lang/ |
Disallow | /src/nocache/ |
Disallow | /*download.php |
Disallow | /src/download.php |
Disallow | /dashboard.php |
Disallow | /buyandread/ |
Disallow | /minside/tipsenvenn/ |
Disallow | /pageflow/ |
Disallow | /minside/brukere/ |
Disallow | /src/lib/blackhole/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://xn--tlt-0na.no/sitemap.xml |