prisjakten.nu
robots.txt

Robots Exclusion Standard data for prisjakten.nu

Resource Scan

Scan Details

Site Domain prisjakten.nu
Base Domain prisjakten.nu
Scan Status Ok
Last Scan2024-10-31T17:41:18+00:00
Next Scan 2024-11-07T17:41:18+00:00

Last Scan

Scanned2024-10-31T17:41:18+00:00
URL http://prisjakten.nu/robots.txt
Redirect https://www.prisjakt.nu/robots.txt
Redirect Domain www.prisjakt.nu
Redirect Base prisjakt.nu
Domain IPs 155.4.22.31, 155.4.22.32
Redirect IPs 104.18.2.221, 104.18.3.221, 2606:4700::6812:2dd, 2606:4700::6812:3dd
Response IP 104.18.2.221
Found Yes
Hash a61c05c6df26edf3c8f8c2947c71cbc7658e933c5b2811b708d67df99c01b489
SimHash e6bfc8c45f42

Groups

msiecrawler
httrack
dataforseobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /admin*
Disallow /instore/
Disallow /account/*
Disallow /signup
Disallow /login
Disallow /forgot-password
Disallow /redirect.php
Disallow /go-to-shop
Disallow /forum_redirect.php
Disallow /review_redirect.php
Disallow /redirect_privatlan.php
Disallow /prislista/
Disallow /prisliste/
Disallow /hinnasto/
Disallow /pricelist/
Disallow /bilder/
Disallow /*?affiliator_click=*
Disallow /*%26affiliator_click%3D*
Disallow /alerts/unsubscribe
Disallow /expert.php
Disallow /_internal/switch-platform/*
Disallow /c/*?*&*&*
Allow /c/*?*&*&offset=*
Disallow /c/*?*sort=*
Disallow /c/*?*stores=*
Disallow /c/*?*b_in_stock=*
Disallow /c/*?*r_user_reviews_rating=*
Disallow /c/*?*rg_days_since_indexing=*
Disallow /search?*
Disallow /product.php?o=*&offset=*
Disallow /produkt.php?o=*&offset=*
Disallow /product.php?e=*&edit=*
Disallow /produkt.php?e=*&edit=*
Disallow /brand.php?*&view=*
Disallow /tillverkare.php?*&view=*
Disallow /brand.php?*&c=*
Disallow /tillverkare.php?*&c=*
Disallow /shop.php?*&lista=*
Disallow /butiksinfo.php/reviews?*&lista=*
Disallow /s/*?offset=*
Disallow /extern/*