pricespy.co.nz
robots.txt
Robots Exclusion Standard data for pricespy.co.nz
Resource Scan
Scan Details
| Site Domain | pricespy.co.nz |
| Base Domain | pricespy.co.nz |
| Scan Status | Ok |
| Last Scan | 2024-10-29T21:46:55+00:00 |
| Next Scan | 2024-11-05T21:46:55+00:00 |
Last Scan
| Scanned | 2024-10-29T21:46:55+00:00 |
| URL | https://pricespy.co.nz/robots.txt |
| Domain IPs | 104.18.14.164, 104.18.15.164, 2606:4700::6812:ea4, 2606:4700::6812:fa4 |
| Response IP | 104.18.14.164 |
| Found | Yes |
| Hash | a61c05c6df26edf3c8f8c2947c71cbc7658e933c5b2811b708d67df99c01b489 |
| SimHash | e6bfc8c45f42 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin* |
| Disallow | /instore/ |
| Disallow | /account/* |
| Disallow | /signup |
| Disallow | /login |
| Disallow | /forgot-password |
| Disallow | /redirect.php |
| Disallow | /go-to-shop |
| Disallow | /forum_redirect.php |
| Disallow | /review_redirect.php |
| Disallow | /redirect_privatlan.php |
| Disallow | /prislista/ |
| Disallow | /prisliste/ |
| Disallow | /hinnasto/ |
| Disallow | /pricelist/ |
| Disallow | /bilder/ |
| Disallow | /*?affiliator_click=* |
| Disallow | /*%26affiliator_click%3D* |
| Disallow | /alerts/unsubscribe |
| Disallow | /expert.php |
| Disallow | /_internal/switch-platform/* |
| Disallow | /c/*?*&*&* |
| Allow | /c/*?*&*&offset=* |
| Disallow | /c/*?*sort=* |
| Disallow | /c/*?*stores=* |
| Disallow | /c/*?*b_in_stock=* |
| Disallow | /c/*?*r_user_reviews_rating=* |
| Disallow | /c/*?*rg_days_since_indexing=* |
| Disallow | /search?* |
| Disallow | /product.php?o=*&offset=* |
| Disallow | /produkt.php?o=*&offset=* |
| Disallow | /product.php?e=*&edit=* |
| Disallow | /produkt.php?e=*&edit=* |
| Disallow | /brand.php?*&view=* |
| Disallow | /tillverkare.php?*&view=* |
| Disallow | /brand.php?*&c=* |
| Disallow | /tillverkare.php?*&c=* |
| Disallow | /shop.php?*&lista=* |
| Disallow | /butiksinfo.php/reviews?*&lista=* |
| Disallow | /s/*?offset=* |
| Disallow | /extern/* |