easy-speak.org
robots.txt
Robots Exclusion Standard data for easy-speak.org
Resource Scan
Scan Details
| Site Domain | easy-speak.org |
| Base Domain | easy-speak.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-28T14:01:13+00:00 |
| Next Scan | 2024-10-05T14:01:13+00:00 |
Last Successful Scan
| Scanned | 2024-08-28T14:00:34+00:00 |
| URL | https://easy-speak.org/robots.txt |
| Domain IPs | 104.26.12.14, 104.26.13.14, 172.67.71.161, 2606:4700:20::681a:c0e, 2606:4700:20::681a:d0e, 2606:4700:20::ac43:47a1 |
| Response IP | 104.26.13.14 |
| Found | Yes |
| Hash | 27a2533ac1b65c91b970eae3d04e4dcc415c0e0f2674a93bd9c01b27f54f216d |
| SimHash | 72d2bb2049c5 |
Groups
libwww-perl
addthis.com
addthis.com
ahrefsbot
aipbot
alexibot
alvinetspider
amazonbot
amfibibot
antenne hatena
antibot
apocalxexplorerbot
asterias
backdoorbot/1.0
baiduspider
becomebot
biglotron
bizinformation
black hole
blowfish/1.0
botalot
bruinbot
builtbottough
bubing
bullseye/1.0
bunnyslippers
catchbot
ccubee
ccubee/3.5
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
combine
converacrawler
converamultimediacrawler
coolbot
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
dimensionet
discobot
disco pump 3.1
dittospyder
dotbot
drecombot
dtaagent
e-societyrobot
emailcollector
emailsiphon
emailwolf
envolk
erocrawler
everbeecrawler
extractorpro
exabot
flamingo_searchengine
foobot
fdse
g2crawler
geniebot
gsa-crawler
harvest/1.5
hloader
hoowwwer
httplib
httrack
httrack 3.0
humanlinks
igentia
infonavirobot
ipselonbot
irlbot
jennybot
jikespider
jyxobot
kavamringcrawler
kenjin spider
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linksmanager
linkwalker
lmspider
lwp-trivial
lwp-trivial/1.34
mata hari
mauibot
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
minibot(naverrobot)/1.0
mister pix
mj12bot
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
msiecrawler
myfamilybot
naverbot
netants
netattache
netmechanic
netresearchserver
nextgensearchbot
nicerspro
noxtrumbot
npbot
nutch
nutchcvs
offline explorer
omniexplorer_bot
openfind
openindexspider
openintelligencedata
phpdig
pompos
propowerbot/2.14
prowebwalker
psbot
quepasacreep
queryn metasearch
radian6
r6_feedfetcher
r6_commentreader
repomonkey
rma
rufusbot
sbider
schibstedsokbot
scspider
searchmetricsbot
semanticdiscovery
semrushbot
shim-crawler
seokicks
spbot
shopwiki
sightupbot
silk
sistrix
sitebot
sitesnagger
sitesucker
slurp
sogou web spider
sosospider
spankbot
spanner
speedy
sproose
steeler
suggybot
superbot
superbot/2.6
suzuran
szukacz/1.4
tarantula
teleport
telesoft
the intraformant
thenomad
theophrastus
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler
tridentspider
true_robot
true_robot/1.0
turingos
turnitinbot
twiceler
ultraseek
urlpouls
urly warning
vagabondo
vci
verticrawlbot
voyager
voyager/1.0
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webindexer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
wget
wikiofeedbot
winhttrack
www-collector-e
xenu link sleuth/1.3.8
xirq
yabrowser
yacy
yandexbot
yrspider
zebot
zebot_www.ze.bz
zeus
zookabot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /ajax/ |
| Disallow | /album_mod/ |
| Disallow | /attach_mod/ |
| Disallow | /backup/ |
| Disallow | /blocks/ |
| Disallow | /cache/ |
| Disallow | /captcha/ |
| Disallow | /ctracker/ |
| Disallow | /datafiles/ |
| Disallow | /db/ |
| Disallow | /docs/ |
| Disallow | /files/ |
| Disallow | /icalcreator/ |
| Disallow | /includes/ |
| Disallow | /ipn/ |
| Disallow | /lang_backup/ |
| Disallow | /language/ |
| Disallow | /mapicons/ |
| Disallow | /media/ |
| Disallow | /mods/ |
| Disallow | /mycalendar_mod/ |
| Disallow | /next/ |
| Disallow | /officerlist.php |
| Disallow | /pdflib/ |
| Disallow | /pdt/ |
| Disallow | /phpBB2/ |
| Disallow | /quiz/ |
| Disallow | /tfpdf/ |
| Disallow | /tinymce/ |
| Disallow | /userpix/ |
| Disallow | /users/ |
| Disallow | /var_cache/ |
| Disallow | /wotd/ |
| Disallow | /xs_mod/ |
| Disallow | /adduser.php |
| Disallow | /attendance.php |
| Disallow | /album.php |
| Disallow | /album_cat.php |
| Disallow | /album_changeposter.php |
| Disallow | /album_comment.php |
| Disallow | /album_comment_edit.php |
| Disallow | /album_comment_delete.php |
| Disallow | /album_delete.php |
| Disallow | /album_edit.php |
| Disallow | /forum.php |
| Disallow | /album_modcp.php |
| Disallow | /album_rate.php |
| Disallow | /album_upload.php |
| Disallow | /alloc_audit.php |
| Disallow | /attendmail.php |
| Disallow | /attach_rules.php |
| Disallow | /attendprint.php |
| Disallow | /attendreport.php |
| Disallow | /book_hist.php |
| Disallow | /bookevent.php |
| Disallow | /changeposter.php |
| Disallow | /cl_edit.php |
| Disallow | /cl_hist.php |
| Disallow | /contact.php |
| Disallow | /cl_report.php |
| Disallow | /club_stats.php |
| Disallow | /common.php |
| Disallow | /config.php |
| Disallow | /ct_login_history.php |
| Disallow | /ctracker_login.php |
| Disallow | /edit_agenda.php |
| Disallow | /edit_post_time.php |
| Disallow | /email_agenda.php |
| Disallow | /email_topic.php |
| Disallow | /extension.inc |
| Disallow | /faq.php |
| Disallow | /groupcp.php |
| Disallow | /kb_changeposter.php |
| Disallow | /kb_search.php |
| Disallow | /lang_swap.php |
| Disallow | /login.php |
| Disallow | /map.php |
| Disallow | /mass_email.php |
| Disallow | /memberlist.php |
| Disallow | /memberchart.php |
| Disallow | /membersurvey.php |
| Disallow | /mycalendar.php |
| Disallow | /modcp.php |
| Disallow | /officerlist.php |
| Disallow | /otm_report.php |
| Disallow | /org_email.php |
| Disallow | /org_make_directory.php |
| Disallow | /paid_until.php |
| Disallow | /payment.php |
| Disallow | /php_info.php |
| Disallow | /portal_add.php |
| Disallow | /portal_edit.php |
| Disallow | /portal_edit_multi.php |
| Disallow | /posting.php |
| Disallow | /privmsg.php |
| Disallow | /profile.php |
| Disallow | /profile_cl.php |
| Disallow | /profile_cc.php |
| Disallow | /profilephoto_mod.php |
| Disallow | /register_club.php |
| Disallow | /request_speech.php |
| Disallow | /satnav.php |
| Disallow | /search.php |
| Disallow | /schedule_speeches.php |
| Disallow | /signup.php |
| Disallow | /site_hist.php |
| Disallow | /speech_introductions.php |
| Disallow | /stats.php |
| Disallow | /switch_view.php |
| Disallow | /tm_a_speech.php |
| Disallow | /tm_assign.php |
| Disallow | /tm_all_speeches.php |
| Disallow | /tm_objective.php |
| Disallow | /tm_speech.php |
| Disallow | /tm_stats.php |
| Disallow | /topic_view_users.php |
| Disallow | /tzshift.php |
| Disallow | /unsubscribe.php |
| Disallow | /upload_default_blocks.php |
| Disallow | /uploadpic.php |
| Disallow | /viewonline.php |
| Disallow | /view_agenda.php |
| Disallow | /viewagenda.php |
| Disallow | /viewforum.php |
| Disallow | /viewtopic.php |
| Disallow | /viewmeeting_mobile.php |
| Disallow | /view_meeting.php |
| Disallow | /webcal_subscribe.php |
| Disallow | /language3.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 240 |
Warnings
- 1 invalid line.