cryspotrio.gr
robots.txt
Robots Exclusion Standard data for cryspotrio.gr
Resource Scan
Scan Details
| Site Domain | cryspotrio.gr |
| Base Domain | cryspotrio.gr |
| Scan Status | Ok |
| Last Scan | 2025-04-10T00:05:15+00:00 |
| Next Scan | 2025-05-10T00:05:15+00:00 |
Last Scan
| Scanned | 2025-04-10T00:05:15+00:00 |
| URL | https://cryspotrio.gr/robots.txt |
| Domain IPs | 104.21.64.15, 172.67.174.26, 2606:4700:3030::ac43:ae1a, 2606:4700:3033::6815:400f |
| Response IP | 172.67.174.26 |
| Found | Yes |
| Hash | 49f0e3ed85596a7dd6ddafdfb52564aa77c843f733d74215a301d99836b59c8a |
| SimHash | c34df4d30c2f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-login.php |
| Disallow | /wp-content/uploads/ |
| Disallow | /cgi-bin/ |
| Disallow | /? |
| Disallow | /*? |
| Disallow | /*.php$ |
| Disallow | /*.inc$ |
| Disallow | /*.gz$ |
| Disallow | /feed/ |
| Disallow | /comments/feed/ |
| Disallow | /trackback/ |
| Disallow | /admin/ |
mj12bot
semrush
rogerbot
ahrefsbot
acunetix
admantx
ahrefsbot
alexibot
alphabot
aqua_products
archive.org_bot
asterias
backdoorbot
backlinkcrawler
backstreet
backweb
badass
bandit
baiduspider
black.hole
blackwidow
blowfish
botalot
builtbottough
bullseye
bunnyslippers
cazoodlebot
cheesebot
cherrypicker
chinaclaw
clipping
copyrightcheck
cosmos
crescent
custo
disco
dittospyder
dotbot
download demon
ecatch
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
express webpictures
extractorpro
eyenetie
fairad client
flashget
foobot
gaisbot
getright
getweb!
go-ahead-got-it
go!zilla
grabnet
grafula
gt::www
harvest
hloader
hmview
httrack
humanlinks
ia_archiver
image stripper
image sucker
infonavirobot
interget
internet ninja
irlbot
jetcar
joc web spider
kenny
larbin
leechftp
lexibot
libweb
libwww-perl
linkextractorpro
linkscan
linkwalker
lnspiderguy
lwp::simple
magnet
mag-net
mass downloader
metauri
mfc_tear_sample
microsoft url control
midown tool
miixpc
mister pix
mj12bot
moget
msiecrawler
navroad
nearsite
netants
netmechanic
netspider
net vampire
netzip
nicerspro
nutch
octopus
offline explorer
offline navigator
openbot
pagegrabber
papa foto
pavuk
pcbrowser
peoplepal
php version tracker
pockey
propowerbot
prowebwalker
psbot
queryn metasearch
realdownload
reget
rippers 0
rssingbot
seamonkey
semrushbot
sitesnagger
slysearch
smartdownload
snoopy
steeler
superbot
superhttp
surfbot
takeout
teleport pro
toata dragostea mea pentru diavola
true_robot
turnitinbot
urly warning
vci
voideye
web image collector
webauto
webbandit
webcopier
webenhancer
webfetch
webgo is
webleacher
webreaper
websauger
website extractor
website quester
webstripper
webwhacker
webzip
wget
widow
wwwoffle
xaldon webspider
yandexbot
zeus
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments