hintaopas.fi
robots.txt

Robots Exclusion Standard data for hintaopas.fi

Resource Scan

Scan Details

Site Domain hintaopas.fi
Base Domain hintaopas.fi
Scan Status Ok
Last Scan2024-10-28T18:18:27+00:00
Next Scan 2024-11-04T18:18:27+00:00

Last Scan

Scanned2024-10-28T18:18:27+00:00
URL https://hintaopas.fi/robots.txt
Domain IPs 104.18.12.69, 104.18.13.69, 2606:4700::6812:c45, 2606:4700::6812:d45
Response IP 104.18.13.69
Found Yes
Hash a61c05c6df26edf3c8f8c2947c71cbc7658e933c5b2811b708d67df99c01b489
SimHash e6bfc8c45f42

Groups

msiecrawler
httrack
dataforseobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /admin*
Disallow /instore/
Disallow /account/*
Disallow /signup
Disallow /login
Disallow /forgot-password
Disallow /redirect.php
Disallow /go-to-shop
Disallow /forum_redirect.php
Disallow /review_redirect.php
Disallow /redirect_privatlan.php
Disallow /prislista/
Disallow /prisliste/
Disallow /hinnasto/
Disallow /pricelist/
Disallow /bilder/
Disallow /*?affiliator_click=*
Disallow /*%26affiliator_click%3D*
Disallow /alerts/unsubscribe
Disallow /expert.php
Disallow /_internal/switch-platform/*
Disallow /c/*?*&*&*
Allow /c/*?*&*&offset=*
Disallow /c/*?*sort=*
Disallow /c/*?*stores=*
Disallow /c/*?*b_in_stock=*
Disallow /c/*?*r_user_reviews_rating=*
Disallow /c/*?*rg_days_since_indexing=*
Disallow /search?*
Disallow /product.php?o=*&offset=*
Disallow /produkt.php?o=*&offset=*
Disallow /product.php?e=*&edit=*
Disallow /produkt.php?e=*&edit=*
Disallow /brand.php?*&view=*
Disallow /tillverkare.php?*&view=*
Disallow /brand.php?*&c=*
Disallow /tillverkare.php?*&c=*
Disallow /shop.php?*&lista=*
Disallow /butiksinfo.php/reviews?*&lista=*
Disallow /s/*?offset=*
Disallow /extern/*