keepfit.no
robots.txt

Robots Exclusion Standard data for keepfit.no

Resource Scan

Scan Details

Site Domain keepfit.no
Base Domain keepfit.no
Scan Status Ok
Last Scan2025-08-25T17:41:15+00:00
Next Scan 2025-09-24T17:41:15+00:00

Last Scan

Scanned2025-08-25T17:41:15+00:00
URL https://www.keepfit.no/robots.txt
Domain IPs 52.17.124.116, 54.195.240.169
Response IP 52.17.124.116
Found Yes
Hash 7dc808732f1d10528b183c06640d4fc8ff4f8eb082e32130f8b590e91a175f56
SimHash e500f3e36051

Groups

*

Rule Path
Allow /
Disallow /kontrollpanel
Disallow /search
Disallow /search_result
Disallow /search_result?*
Disallow /cookie_usage
Disallow /htmlpackingmanifest.php
Disallow /htmlpackingmanifest.php?*
Disallow /htmlpackingslip_new.php
Disallow /htmlpackingslip_new.php?*
Disallow /htmlpackingslip.php
Disallow /htmlpackingslip.php?*
Disallow /htmlpackingslip_meters.php
Disallow /htmlpackingslip_meters.php?*
Disallow /order_confirmation.php
Disallow /order_confirmation.php?*
Disallow /pdfinvoice.php
Disallow /pdfinvoice.php?*
Disallow /pdf_kredittnota.php
Disallow /pdf_kredittnota.php?*
Disallow /pdf_angreskjema.php
Disallow /pdf_angreskjema.php?*
Disallow /htmlreturnsform.php
Disallow /htmlreturnsform.php?*
Disallow /htmlinvoice_new.php
Disallow /htmlinvoice_new.php?*
Disallow /htmlgiftcard.php
Disallow /htmlgiftcard.php?*

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

oai-searchbot

Rule Path
Allow /