pricespy.co.uk
robots.txt

Robots Exclusion Standard data for pricespy.co.uk

Resource Scan

Scan Details

Site Domain pricespy.co.uk
Base Domain pricespy.co.uk
Scan Status Ok
Last Scan2025-07-28T16:46:45+00:00
Next Scan 2025-08-04T16:46:45+00:00

Last Scan

Scanned2025-07-28T16:46:45+00:00
URL https://pricespy.co.uk/robots.txt
Domain IPs 104.18.28.124, 104.18.29.124, 2606:4700::6812:1c7c, 2606:4700::6812:1d7c
Response IP 104.18.29.124
Found Yes
Hash abcec89b8676efe11cbb6ea1111aee01be20ea5e36461455688efa7931b164d4
SimHash b67dc9c45f42

Groups

msiecrawler
httrack
dataforseobot

Rule Path
Disallow /

*

Rule Path
Disallow /admin*
Disallow /instore/
Disallow /account/*
Disallow /signup
Disallow /login
Disallow /forgot-password
Disallow /redirect.php
Disallow /go-to-shop
Disallow /forum_redirect.php
Disallow /review_redirect.php
Disallow /redirect_privatlan.php
Disallow /prislista/
Disallow /prisliste/
Disallow /hinnasto/
Disallow /pricelist/
Disallow /bilder/
Disallow /*?affiliator_click=*
Disallow /*%26affiliator_click%3D*
Disallow /alerts/unsubscribe
Disallow /expert.php
Disallow /_internal/switch-platform/*
Disallow /c/*?*&*&*
Allow /c/*?*&*&offset=*
Disallow /c/*?*sort=*
Disallow /c/*?*stores=*
Disallow /c/*?*b_in_stock=*
Disallow /c/*?*r_user_reviews_rating=*
Disallow /c/*?*rg_days_since_indexing=*
Disallow /search?*
Disallow /product.php?o=*&offset=*
Disallow /produkt.php?o=*&offset=*
Disallow /product.php?e=*&edit=*
Disallow /produkt.php?e=*&edit=*
Disallow /brand.php?*&view=*
Disallow /tillverkare.php?*&view=*
Disallow /brand.php?*&c=*
Disallow /tillverkare.php?*&c=*
Disallow /shop.php?*&lista=*
Disallow /butiksinfo.php/reviews?*&lista=*
Disallow /s/*?offset=*
Disallow /extern/*
Disallow /amp/*