e-sga.org
robots.txt
Robots Exclusion Standard data for e-sga.org
Resource Scan
Scan Details
| Site Domain | e-sga.org |
| Base Domain | e-sga.org |
| Scan Status | Ok |
| Last Scan | 2024-06-21T23:49:41+00:00 |
| Next Scan | 2024-07-21T23:49:41+00:00 |
Last Scan
| Scanned | 2024-06-21T23:49:41+00:00 |
| URL | https://e-sga.org/robots.txt |
| Domain IPs | 37.202.3.133 |
| Response IP | 37.202.3.133 |
| Found | Yes |
| Hash | 5b32d831907c23ec8de203c6299668581c7817001eef2c40ea69bffab582dca4 |
| SimHash | 262c84326ce3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /t3lib/ |
| Disallow | /typo3/ |
| Disallow | /typo3conf/ |
| Disallow | /shop/cart/ |
| Disallow | /shop/checkout/ |
| Disallow | /login-form/ |
| Disallow | /members/ |
| Allow | /typo3conf/ext/*/Resources/Public/* |
| Allow | /typo3/sysext/core/Resources/Public/Icons/* |
| Allow | /typo3temp/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /*?id=* |
| Disallow | /*?showOptIn=1 |
| Disallow | /*%26showOptIn%3D1 |
| Disallow | /*tx_powermail_pi1 |
| Disallow | /*tx_form_formframework |
| Disallow | /*?type=* |
| Disallow | /*%26type%3D* |
| Disallow | /*?tx_multishop_pi1 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
qwant-news
qwantify
megaindex
re-re studio
petalbot
sqlmap
sqlworm
baiduspider
haosou 360 spider
sogou spider
sogou spider
sogou web spider
ahrefsbot
proximic bot
semrushbot
dotmic dotbot
yisouspider
admantx bot
grapeshot bot
alexa bot
fnetwork bot
adobe air
paessler monitor
uptimebot
site24x7 tools
keynote
seokicks
serpstatbot
seokicks-robot
sistrix
majesticseo
backlinkcrawler
mj12bot
spbot
searchmetricsbot
search17
ia_archiver
turnitinbot
slysearch
findlinks
magpie-crawler
pixray-seeker
ezooms
lb-spider
wbsearchbot
psbot
huaweisymantecspider
ec2linkfinder
htdig
semrushbot
discobot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
icjobs
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
larbin
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
dotbot
ltx71
nmap
velen.io
netestate ne crawler
cmscrawler
mail.ru_bot
gynxbot
riddler
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | |/sitemap.xml |
Warnings
- 2 invalid lines.
Comments