lavpriskurven.no
robots.txt

Robots Exclusion Standard data for lavpriskurven.no

Resource Scan

Scan Details

Site Domain lavpriskurven.no
Base Domain lavpriskurven.no
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-20T07:30:06+00:00
Next Scan 2025-12-20T07:30:06+00:00

Last Successful Scan

Scanned2025-09-28T05:15:37+00:00
URL https://lavpriskurven.no/robots.txt
Domain IPs 54.195.240.169
Response IP 54.195.240.169
Found Yes
Hash 51d6c729b37769db63c983e93ad1861969fcb60296680897a1c645eac835be1b
SimHash e510bb636051

Groups

*

Rule Path
Allow /
Disallow /kontrollpanel
Disallow /search
Disallow /search_result
Disallow /search_result?*
Disallow /cookie_usage
Disallow /htmlpackingmanifest.php
Disallow /htmlpackingmanifest.php?*
Disallow /htmlpackingslip_new.php
Disallow /htmlpackingslip_new.php?*
Disallow /htmlpackingslip.php
Disallow /htmlpackingslip.php?*
Disallow /htmlpackingslip_meters.php
Disallow /htmlpackingslip_meters.php?*
Disallow /order_confirmation.php
Disallow /order_confirmation.php?*
Disallow /pdfinvoice.php
Disallow /pdfinvoice.php?*
Disallow /pdf_kredittnota.php
Disallow /pdf_kredittnota.php?*
Disallow /pdf_angreskjema.php
Disallow /pdf_angreskjema.php?*
Disallow /htmlreturnsform.php
Disallow /htmlreturnsform.php?*
Disallow /htmlinvoice_new.php
Disallow /htmlinvoice_new.php?*
Disallow /htmlgiftcard.php
Disallow /htmlgiftcard.php?*

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

oai-searchbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /