justmarket.gr
robots.txt

Robots Exclusion Standard data for justmarket.gr

Resource Scan

Scan Details

Site Domain justmarket.gr
Base Domain justmarket.gr
Scan Status Ok
Last Scan2025-04-08T04:26:20+00:00
Next Scan 2025-05-08T04:26:20+00:00

Last Scan

Scanned2025-04-08T04:26:20+00:00
URL https://justmarket.gr/robots.txt
Redirect https://www.justmarket.gr/robots.txt
Redirect Domain www.justmarket.gr
Redirect Base justmarket.gr
Domain IPs 104.21.11.118, 172.67.166.1, 2606:4700:3030::ac43:a601, 2606:4700:3032::6815:b76
Redirect IPs 104.21.11.118, 172.67.166.1, 2606:4700:3030::ac43:a601, 2606:4700:3032::6815:b76
Response IP 104.21.11.118
Found Yes
Hash 08ce59fcdad51a40ebc2520145bf7a750473d7c7b4e29f0ec393f9544dd2e5fb
SimHash c34df4d30c2f

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-content/uploads/
Disallow /cgi-bin/
Disallow /?
Disallow /*?
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /feed/
Disallow /comments/feed/
Disallow /trackback/
Disallow /admin/

semrush
rogerbot
ahrefsbot
acunetix
admantx
ahrefsbot
alexibot
alphabot
aqua_products
archive.org_bot
asterias
backdoorbot
backlinkcrawler
backstreet
backweb
badass
bandit
baiduspider
black.hole
blackwidow
blowfish
botalot
builtbottough
bullseye
bunnyslippers
cazoodlebot
cheesebot
cherrypicker
chinaclaw
clipping
copyrightcheck
cosmos
crescent
custo
disco
dittospyder
dotbot
download demon
ecatch
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
express webpictures
extractorpro
eyenetie
fairad client
flashget
foobot
gaisbot
getright
getweb!
go-ahead-got-it
go!zilla
grabnet
grafula
gt::www
harvest
hloader
hmview
httrack
humanlinks
ia_archiver
image stripper
image sucker
infonavirobot
interget
internet ninja
irlbot
jetcar
joc web spider
kenny
larbin
leechftp
lexibot
libweb
libwww-perl
linkextractorpro
linkscan
linkwalker
lnspiderguy
lwp::simple
magnet
mag-net
mass downloader
metauri
mfc_tear_sample
microsoft url control
midown tool
miixpc
mister pix
mj12bot
moget
msiecrawler
navroad
nearsite
netants
netmechanic
netspider
net vampire
netzip
nicerspro
nutch
octopus
offline explorer
offline navigator
openbot
pagegrabber
papa foto
pavuk
pcbrowser
peoplepal
php version tracker
pockey
propowerbot
prowebwalker
psbot
queryn metasearch
realdownload
reget
rippers 0
rssingbot
seamonkey
semrushbot
sitesnagger
slysearch
smartdownload
snoopy
steeler
superbot
superhttp
surfbot
takeout
teleport pro
toata dragostea mea pentru diavola
true_robot
turnitinbot
urly warning
vci
voideye
web image collector
webauto
webbandit
webcopier
webenhancer
webfetch
webgo is
webleacher
webreaper
websauger
website extractor
website quester
webstripper
webwhacker
webzip
wget
widow
wwwoffle
xaldon webspider
yandexbot
zeus
zyborg

Rule Path
Disallow /

Comments

  • Block known bad bots

Warnings

  • 1 invalid line.