ytringen.no
robots.txt
Robots Exclusion Standard data for ytringen.no
Resource Scan
Scan Details
Site Domain | ytringen.no |
Base Domain | ytringen.no |
Scan Status | Ok |
Last Scan | 2024-11-08T01:52:24+00:00 |
Next Scan | 2024-11-15T01:52:24+00:00 |
Last Scan
Scanned | 2024-11-08T01:52:24+00:00 |
URL | https://ytringen.no/robots.txt |
Domain IPs | 95.217.68.68 |
Response IP | 95.217.68.68 |
Found | Yes |
Hash | 9ebca97471b51fdafa6c08ac915848ea7335bb4f8a40333d331dfae950641de3 |
SimHash | 4b15cc90f982 |
Groups
semrushbot
ahrefsbot
serpstatbot
dataforseobot
mj12bot
sentibot
yandexbot
petalbot
neticle
buck
cookieinformationscanner
trendictionbot
velenpublicwebcrawler
other
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /webdesk/ |
Disallow | /search |
Disallow | /index.php*%26do%3Dsok* |
Disallow | /api/ |
Disallow | /conf/ |
Disallow | /src/lang/ |
Disallow | /src/nocache/ |
Disallow | /*download.php |
Disallow | /src/download.php |
Disallow | /dashboard.php |
Disallow | /buyandread/ |
Disallow | /minside/tipsenvenn/ |
Disallow | /pageflow/ |
Disallow | /minside/brukere/ |
Disallow | /src/lib/blackhole/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://ytringen.no/sitemap.xml |