bilkomponenter.no
robots.txt

Robots Exclusion Standard data for bilkomponenter.no

Resource Scan

Scan Details

Site Domain bilkomponenter.no
Base Domain bilkomponenter.no
Scan Status Ok
Last Scan2025-09-21T02:48:37+00:00
Next Scan 2025-10-21T02:48:37+00:00

Last Scan

Scanned2025-09-21T02:48:37+00:00
URL https://bilkomponenter.no/robots.txt
Redirect https://www.bilkomponenter.no/robots.txt
Redirect Domain www.bilkomponenter.no
Redirect Base bilkomponenter.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 52.17.124.116, 54.195.240.169
Response IP 54.195.240.169
Found Yes
Hash 51d6c729b37769db63c983e93ad1861969fcb60296680897a1c645eac835be1b
SimHash e510bb636051

Groups

*

Rule Path
Allow /
Disallow /kontrollpanel
Disallow /search
Disallow /search_result
Disallow /search_result?*
Disallow /cookie_usage
Disallow /htmlpackingmanifest.php
Disallow /htmlpackingmanifest.php?*
Disallow /htmlpackingslip_new.php
Disallow /htmlpackingslip_new.php?*
Disallow /htmlpackingslip.php
Disallow /htmlpackingslip.php?*
Disallow /htmlpackingslip_meters.php
Disallow /htmlpackingslip_meters.php?*
Disallow /order_confirmation.php
Disallow /order_confirmation.php?*
Disallow /pdfinvoice.php
Disallow /pdfinvoice.php?*
Disallow /pdf_kredittnota.php
Disallow /pdf_kredittnota.php?*
Disallow /pdf_angreskjema.php
Disallow /pdf_angreskjema.php?*
Disallow /htmlreturnsform.php
Disallow /htmlreturnsform.php?*
Disallow /htmlinvoice_new.php
Disallow /htmlinvoice_new.php?*
Disallow /htmlgiftcard.php
Disallow /htmlgiftcard.php?*

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

oai-searchbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /