jetcost.no
robots.txt

Robots Exclusion Standard data for jetcost.no

Resource Scan

Scan Details

Site Domain jetcost.no
Base Domain jetcost.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-19T22:24:11+00:00
Next Scan 2026-01-26T22:24:11+00:00

Last Successful Scan

Scanned2022-11-21T09:28:04+00:00
URL https://jetcost.no/robots.txt
Redirect https://www.jetcost.no/robots.txt
Redirect Domain www.jetcost.no
Redirect Base jetcost.no
Response IP 104.18.9.199, 104.18.8.199
Found Yes
Hash ec2ef80b260c2e45e38bf6a4d13eb12dbdd55603ba6534b8613a1b609385346f
SimHash 730cf1416cd3

Groups

*

Rule Path
Disallow /flyvninger/resultater/**/*/*
Disallow /flyvninger/sok
Disallow /flyvninger/reader
Disallow /flyvninger/gateway
Disallow /flyvninger/gatewayclickout
Disallow /flyvninger/re-search
Disallow /flyvninger/re-search-params
Disallow /flyvninger/gatewaycug
Disallow /leiebil/results/**/**
Disallow /leiebil/search
Disallow /leiebil/reader
Disallow /leiebil/gateway
Disallow /leiebil/gatewayclickout
Disallow /api/**
Disallow /wait.php

Other Records

Field Value
sitemap https://www.jetcost.no/sitemap.xml