dk.pricerunner.com
robots.txt
Robots Exclusion Standard data for dk.pricerunner.com
Resource Scan
Scan Details
| Site Domain | dk.pricerunner.com |
| Base Domain | pricerunner.com |
| Scan Status | Ok |
| Last Scan | 2024-09-17T09:26:21+00:00 |
| Next Scan | 2024-10-17T09:26:21+00:00 |
Last Scan
| Scanned | 2024-09-17T09:26:21+00:00 |
| URL | https://dk.pricerunner.com/robots.txt |
| Redirect | https://www.pricerunner.dk/robots.txt |
| Redirect Domain | www.pricerunner.dk |
| Redirect Base | pricerunner.dk |
| Domain IPs | 54.154.2.6, 54.246.185.106, 79.125.58.83 |
| Redirect IPs | 108.157.254.112, 108.157.254.119, 108.157.254.68, 108.157.254.82 |
| Response IP | 108.157.254.68 |
| Found | Yes |
| Hash | 917b8620563e43e0785ba1c5a6ffc09b9d34505b3144c1dddf02288a1140070b |
| SimHash | b5d57146c893 |
Groups
baiduspider
baiduspider-image
baiduspider-video
blexbot
dataforseobot
doc
download ninja
fetch
grapeshot
httrack
jikespider
kollbot
larbin
linko
microadbot
msiecrawler
offline explorer
orthogaffe
petalbot
proximic
seoscanners
seznambot
sitecheck.internetseer.com
sitesnagger
sogou
sogou spider
sosospider
teleport
teleportpro
ubicrawler
wbsearchbot
webcopier
webstripper
webzip
yandexbot
zao
zealbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*ref-site |
| Disallow | /gotostore/ |
| Disallow | /track/ |
| Disallow | /checkout/ |
| Disallow | /login |
| Disallow | /forum |
| Disallow | /profile |
| Disallow | /vr/ |
| Disallow | /70081414/ |
| Disallow | /ct/ |
| Disallow | /*other_hits%3D |
| Disallow | /*search%3D |
| Disallow | /*ref%3D |
| Disallow | /cl/*attr_*attr_*attr_*attr_*attr_*attr_* |
| Disallow | /cl/*attr_*%2C* |
| Disallow | /cl/*man_id*attr_*attr_*attr_*attr_*attr_* |
| Disallow | /deals? |
| Disallow | /*s_price_drop%3D |
| Disallow | /public/search/pricehistory/ |
| Disallow | /public/pricehistory/product/ |
| Disallow | /results |
| Disallow | /pl/*p%3D* |
| Disallow | /cl/*?q=* |
| Disallow | /cl/*%26q%3D* |
| Disallow | /pc/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pricerunner.dk/public/v1/sitemap/DK/sitemap.xml |
Warnings
- 1 invalid line.
Comments