trav365.no
robots.txt

Robots Exclusion Standard data for trav365.no

Resource Scan

Scan Details

Site Domain trav365.no
Base Domain trav365.no
Scan Status Ok
Last Scan2025-06-04T07:49:20+00:00
Next Scan 2025-06-11T07:49:20+00:00

Last Scan

Scanned2025-06-04T07:49:20+00:00
URL https://trav365.no/robots.txt
Domain IPs 95.217.68.68
Response IP 95.217.68.68
Found Yes
Hash 8c9ca787703c9981a39112c51c85029b7a478b0831dbae1040055e1cfde7bf89
SimHash 4b14cc10f982

Groups

semrushbot
ahrefsbot
serpstatbot
dataforseobot
mj12bot
sentibot
yandexbot
petalbot
neticle
buck
cookieinformationscanner
trendictionbot
velenpublicwebcrawler
other

Rule Path
Disallow /

*

Rule Path
Disallow /webdesk/
Disallow /search
Disallow /index.php*%26do%3Dsok*
Disallow /api/
Disallow /conf/
Disallow /src/lang/
Disallow /src/nocache/
Disallow /*download.php
Disallow /src/download.php
Disallow /dashboard.php
Disallow /buyandread/
Disallow /minside/tipsenvenn/
Disallow /pageflow/
Disallow /minside/brukere/
Disallow /src/lib/blackhole/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://trav365.no/sitemap.xml