e-nologia.com
robots.txt
Robots Exclusion Standard data for e-nologia.com
Resource Scan
Scan Details
| Site Domain | e-nologia.com |
| Base Domain | e-nologia.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T05:30:19+00:00 |
| Next Scan | 2024-07-07T05:30:19+00:00 |
Last Scan
| Scanned | 2024-06-07T05:30:19+00:00 |
| URL | https://e-nologia.com/robots.txt |
| Redirect | https://www.e-nologia.com/robots.txt |
| Redirect Domain | www.e-nologia.com |
| Redirect Base | e-nologia.com |
| Domain IPs | 148.251.21.219, 2a01:4f8:201:82c4::2 |
| Redirect IPs | 148.251.21.219, 2a01:4f8:201:82c4::2 |
| Response IP | 148.251.21.219 |
| Found | Yes |
| Hash | ad08e5ae5ca8e5389ff18a48e6c44cd67f7cbea4c00d73d47595f353a01ab887 |
| SimHash | b85364d0b543 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /legal/ |
| Disallow | /email.php |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known/apple-app-site-association |
| Disallow | /*.inc |
| Disallow | /*.txt |
| Disallow | /sellers.json |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
a6-indexer
ahrefsbot
alphaseobot
b-l-i-t-z-b-o-t
barkrowler
boardreader
bomborabot
buck
catexplorador
clickagy
dataprovider
deusu
dnyzbot
domaincrawler
domainsigmacrawler
fbsmtwb
flamingo
garlikcrawler
grapeshotcrawler
java
jooblebot
keybot translation-search-machine
lightspeedsystems
linkpadbot
linqiametadatadownloaderbot
mj12bot
mail.ru_bot
mauibot
megaindex
metauri
netcraft
openlinkprofiler
plukkie
pubmatic crawler bot
seokicks
smtbot
semrushbot
serpstatbot
sirdatabot
siteimprove
surdotlybot
surveybot
synthesio
todoexpertosbot
turnitinbot
tweetmemebot
twingly
urlappendbot
webdatastats
xovibot
yisouspider
zoombot
zoominfobot
cmscrawler
datagnion
grammarly
linkdexbot
linkfluence
ltx71
magpie-crawler
moreover
obot
omgili
panscient
proximic
rogerbot
scrapinghub
sistrix
ubermetrics
vebidoobot
woorankreview
| Rule | Path |
|---|---|
| Disallow | / |
aboundex
adauth
adbeat_bot
adnormcrawler
adsbot
anthropic-ai
asafaweb
awariobot
bananabot
bitsightbot
blexbot
buzzbot
bytespider
castlebot
checkmarknetwork
claudebot
crawlson
crazywebcrawler-spider
cyotekwebcopy
dataforseobot
dataprovider
disqusadstxtcrawler
domainappender
domainstatsbot
dotbot
dlvr.it
electricmonk
embarcadero
ezooms
fidget-spinner-bot
foregenix
gptbot
grouphigh
hubspot
internetmeasurement
ioncrawl
jamesbot
komodiabot
madbbot
mixrankbot
nextgensearchbot
pandalytics
phantombot
probethenet
r6_feedfetcher
rankurbot
ravencrawler
riddler
safednsbot
salesintelligent
sbider
sciencelogic
schemabot
scopia
scoutjet
searchmetricsbot
sentibot
seobilitybot
seodiver
serpstatbot
siteexplorer
spawning-ai
thesafeinternetxsearch
thesis-research-bot
tinytestbot
tweetmemebot
trendictionbot
t3versionsbot
urlsumabot
velenpublicwebcrawler
voltron
webprosbot
websusebot
wellknownbot
wesee
zaldamosearchbot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments