devicehub.co.uk
robots.txt

Robots Exclusion Standard data for devicehub.co.uk

Resource Scan

Scan Details

Site Domain devicehub.co.uk
Base Domain devicehub.co.uk
Scan Status Ok
Last Scan2026-03-05T23:57:22+00:00
Next Scan 2026-04-04T23:57:22+00:00

Last Scan

Scanned2026-03-05T23:57:22+00:00
URL https://devicehub.co.uk/robots.txt
Redirect https://www.pcnova.co.uk/robots.txt
Redirect Domain www.pcnova.co.uk
Redirect Base pcnova.co.uk
Domain IPs 104.26.14.53, 104.26.15.53, 172.67.70.22, 2606:4700:20::681a:e35, 2606:4700:20::681a:f35, 2606:4700:20::ac43:4616
Redirect IPs 104.26.0.78, 104.26.1.78, 172.67.72.99, 2606:4700:20::681a:14e, 2606:4700:20::681a:4e, 2606:4700:20::ac43:4863
Response IP 104.26.1.78
Found Yes
Hash b4893ae9176d507d815dab27cc4454fee17f083bf0f6604539d8a1ecaec8d289
SimHash d23df843e71b

Groups

*

Rule Path
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /magento/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /var/
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*?SID=
Disallow /*?manufacturer=
Disallow /*%26sinch_attr_
Disallow /*?price=
Disallow /*%26price%3D
Disallow /*?color=
Disallow /*%26color%3D
Disallow /*?material=
Disallow /*%26material%3D
Disallow /*?size=
Disallow /*%26size%3D
Disallow /*%26p%3D
Disallow /*%26mode%3D
Disallow /*?limit=
Disallow /*?PHPSESSID=

semrushbot
semrushbot-sa
semrushbot-ba
ahrefsbot
blexbot
baiduspider
baiduspider-image
baiduspider-video
mj12bot
dotbot
ezooms
ia_archiver
rogerbot
moget
ichiro
sogou spider
youdaobot
naverbot
yeti
nutch
pricebot
pinterestbot
claudebot
amazonbot
gptbot
petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /search/
Disallow /catalogsearch/result/?

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.pcnova.co.uk/sitemap/sitemap.xml

Comments

  • User-agent: Googlebot
  • Crawl-delay: 5
  • Aggressive bots
  • Moderate Bingbot
  • Optional: Allow Idealo
  • User-agent: idealo-bot
  • Disallow:
  • Optional: Uncomment if Yandex needs blocking
  • User-agent: Yandex
  • Disallow: /