prisjagt.dk
robots.txt

Robots Exclusion Standard data for prisjagt.dk

Resource Scan

Scan Details

Site Domain prisjagt.dk
Base Domain prisjagt.dk
Scan Status Ok
Last Scan2024-10-31T18:03:44+00:00
Next Scan 2024-11-07T18:03:44+00:00

Last Scan

Scanned2024-10-31T18:03:44+00:00
URL https://prisjagt.dk/robots.txt
Domain IPs 104.18.14.28, 104.18.15.28, 2606:4700::6812:e1c, 2606:4700::6812:f1c
Response IP 104.18.15.28
Found Yes
Hash a61c05c6df26edf3c8f8c2947c71cbc7658e933c5b2811b708d67df99c01b489
SimHash e6bfc8c45f42

Groups

msiecrawler
httrack
dataforseobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /admin*
Disallow /instore/
Disallow /account/*
Disallow /signup
Disallow /login
Disallow /forgot-password
Disallow /redirect.php
Disallow /go-to-shop
Disallow /forum_redirect.php
Disallow /review_redirect.php
Disallow /redirect_privatlan.php
Disallow /prislista/
Disallow /prisliste/
Disallow /hinnasto/
Disallow /pricelist/
Disallow /bilder/
Disallow /*?affiliator_click=*
Disallow /*%26affiliator_click%3D*
Disallow /alerts/unsubscribe
Disallow /expert.php
Disallow /_internal/switch-platform/*
Disallow /c/*?*&*&*
Allow /c/*?*&*&offset=*
Disallow /c/*?*sort=*
Disallow /c/*?*stores=*
Disallow /c/*?*b_in_stock=*
Disallow /c/*?*r_user_reviews_rating=*
Disallow /c/*?*rg_days_since_indexing=*
Disallow /search?*
Disallow /product.php?o=*&offset=*
Disallow /produkt.php?o=*&offset=*
Disallow /product.php?e=*&edit=*
Disallow /produkt.php?e=*&edit=*
Disallow /brand.php?*&view=*
Disallow /tillverkare.php?*&view=*
Disallow /brand.php?*&c=*
Disallow /tillverkare.php?*&c=*
Disallow /shop.php?*&lista=*
Disallow /butiksinfo.php/reviews?*&lista=*
Disallow /s/*?offset=*
Disallow /extern/*