bestprice.gr
robots.txt

Robots Exclusion Standard data for bestprice.gr

Resource Scan

Scan Details

Site Domain bestprice.gr
Base Domain bestprice.gr
Scan Status Ok
Last Scan2024-09-20T17:19:23+00:00
Next Scan 2024-09-27T17:19:23+00:00

Last Scan

Scanned2024-09-20T17:19:23+00:00
URL https://bestprice.gr/robots.txt
Redirect https://www.bestprice.gr/robots.txt
Redirect Domain www.bestprice.gr
Redirect Base bestprice.gr
Domain IPs 139.91.201.56, 62.103.124.11, 62.103.124.4
Redirect IPs 139.91.201.56, 62.103.124.11
Response IP 62.103.124.4
Found Yes
Hash 531462594ade84b28bee22bc24eced9f2d20cffb3d5aed738709af97b8bd5fac
SimHash e91e5296e9b3

Groups

*

Rule Path
Disallow /cart
Disallow /404
Disallow /oops
Disallow /error
Disallow /env
Disallow /legacy
Disallow /login
Disallow /logout
Disallow /api
Disallow /to
Disallow /deals-new
Disallow /collection
Disallow /compare
Disallow /badge
Disallow /chrome
Disallow /notifications
Disallow /badgetFetch
Disallow /item/*/reviews
Disallow /m/*/reviews
Disallow /search?q=*&deals=*&f1=*
Disallow /*?nearby=*

baiduspider

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

cherry picker

Rule Path
Disallow /

control

Rule Path
Disallow /

crescent internet toolpak

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

grub

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

htdig

Rule Path
Disallow /

httrack

Rule Path
Disallow /

internetseer.com

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mfc foundation class library

Rule Path
Disallow /

microsoft

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows nt)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 95)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 98)

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

netprospector

Rule Path
Disallow /

oodlebot/1.0

Rule Path
Disallow /

perman surfer

Rule Path
Disallow /

psbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

teleport

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

ultraseek

Rule Path
Disallow /

vspider

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webemailextractor

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

ruby

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bestprice.gr/sitemaps/site_index.xml.gz
sitemap https://www.bestprice.gr/sitemaps/inv_index.xml.gz

Comments

  • Ref: pricegrabber.com/robots.txt
  • Let's ride together! https://www.bestprice.gr/careers

Warnings

  • 3 invalid lines.