teledigo.com
robots.txt
Robots Exclusion Standard data for teledigo.com
Resource Scan
Scan Details
| Site Domain | teledigo.com |
| Base Domain | teledigo.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T16:55:26+00:00 |
| Next Scan | 2024-06-02T16:55:26+00:00 |
Last Scan
| Scanned | 2024-05-03T16:55:26+00:00 |
| URL | https://teledigo.com/robots.txt |
| Redirect | https://www.teledigo.com/robots.txt |
| Redirect Domain | www.teledigo.com |
| Redirect Base | teledigo.com |
| Domain IPs | 107.180.50.218 |
| Redirect IPs | 107.180.50.218 |
| Response IP | 107.180.50.218 |
| Found | Yes |
| Hash | 98a8974a07b97778166958fdf572b8c7d475ccc494fd293e3b0437af64d4ccab |
| SimHash | 557745307618 |
Groups
amazonadbot
applebot
bingbot
criteobot/0.1
petalbot
proximic
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
arquivo-web-crawler
adsbot/3.1
admantx
adscanner
ahc/2.1
ahrefsbot
ahrefsbot/7.0
archivebot
aspiegelbot
awariosmartbot
baiduspider
baiduspider/2.0
barkrowler/0.9
barkrowler
bidswitchbot/1.0
blekkobot
blexbot
blexbot/1.0
mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)
bubing
bytespider
ccbot
ccbot/2.0
cincraw/1.0
cliqzbot
coccocbot-web
coccocbot-web/1.0
cowbot/1.0
criteobot/0.1
curious george
curious george - www.analyticsseo.com
curious george - www.analyticsseo.com/crawler
crawlson/1.0
curebot
dataforseobot/1.0
datanyze
daum
deskyobot
deskyobot/1.0
df bot 1.0
domaincrawler
dotbot
dotbot/1.2
ev-crawler
ev-crawler/1.0
filibot/1.0
genieo
genieo/1.0
gluten free crawler/1.0
grapeshot
grapeshotcrawler
grapeshotcrawler/2.0
grouphigh
grouphigh/1.0
ia_archiver
ias-crawler
ias-ir/3.1
ias-jp/3.1
ias-or/3.1
ias-sg/3.1
ias-va/3.1
istellabot
istellabot/1.01.18
istellabot/1.01.18 +http://www.tiscali.it/
istellabot/1.10.2 +http://www.tiscali.it/
mozilla/5.0 (compatible; istellabot/1.01.18 +http://www.tiscali.it/)
ioncrawl
james bot
leikibot
libcurl
linkdexbot
lipperhey
livelap
lssrocket
ltx71
ltx71+-+(http://ltx71.com/)
mauibot
magpie
mail.ru
mail.ru_bot
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
mauibot (crawler.feedback+wc@gmail.com)
mediatoolkitbot
micromessenger
mj12bot
mj12bot/v1.4.8
mojeekbot
mozilla/5.0 (compatible; mojeekbot/0.10; +https://www.mojeek.com/bot.html)
mr.4x3 powered
neevabot/1.0
obot/2.3.1
pagepeeker
pandalytics/1.0
panscient.com
pi-monster
proximic
quantcastbot
quantcastbot/1.0
scoutjet
screaming.frog
seekport crawler
semanticbot/1.0
semrushbot
semrushbot/7~bl
seobility
seokicks
serendeputybot
serendeputybot/0.8.6
serpstatbot/1.0
seznambot
seznambot/3.2
seznambot/4.0-rc1
siteimprove.com
sjuupbot
sogou spider
sogou web spider/4.0
sputnik
sputnikbot
sputnikbot/2.3
surdotlybot
surdotlybot/1.0
mozilla/5.0 (compatible; surdotlybot/1.0; +http://sur.ly/bot.html)
steeler
steeler/3.5
the knowledge ai
tpradstxtcrawler
tpradstxtcrawler/1.1
tracemyfile/1.0
trendictionbot
mozilla/5.0 (compatible; trendsmapresolver/0.1)
mozilla/5.0 (compatible; ttd-content; +https://www.thetradedesk.com/general/ttd-content)
turnitinbot
twingly recon-klondike/1.0
uipbot/1.0
um-ln/1.0
mozilla/5.0 (compatible; um-ln/1.0; mailto: techinfo@ubermetrics-technologies.com; windows nt 6.1; wow64; rv:40.0)
uptimebot
velenpublicwebcrawler
viglink
weborama-fetcher
wellknownbot/0.1
woorankreview/2.0
yak
yak/1.0
yandex
yandexbot
yandexbot/3.0
yeti
yeti-mobile
yisouspider
zgrab
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- `request-rate` is not a known field.