colorate.azurewebsites.net
robots.txt

Robots Exclusion Standard data for colorate.azurewebsites.net

Resource Scan

Scan Details

Site Domain colorate.azurewebsites.net
Base Domain colorate.azurewebsites.net
Scan Status Ok
Last Scan2025-08-28T23:42:07+00:00
Next Scan 2025-09-04T23:42:07+00:00

Last Scan

Scanned2025-08-28T23:42:07+00:00
URL https://colorate.azurewebsites.net/robots.txt
Domain IPs 138.91.16.18
Response IP 138.91.16.18
Found Yes
Hash 021fde463be9df0cef88986041e9a09e4e781eb68f1cc8c5f9136662dc3c0caa
SimHash 881edb6023cd

Groups

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /Blend
Disallow /*/Blend
Disallow /Gradient
Disallow /*/Gradient
Disallow /zh
Disallow /de
Disallow /fr
Disallow /it

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Disallow /Blend
Disallow /*/Blend
Disallow /Gradient
Disallow /*/Gradient
Disallow /zh
Disallow /de
Disallow /fr
Disallow /it

Other Records

Field Value
crawl-delay 30

bingbot

Rule Path
Disallow /Blend
Disallow /*/Blend
Disallow /Gradient
Disallow /*/Gradient
Disallow /zh
Disallow /de
Disallow /fr
Disallow /it

Other Records

Field Value
crawl-delay 30

bingpreview

Rule Path
Disallow /Blend
Disallow /*/Blend
Disallow /Gradient
Disallow /*/Gradient
Disallow /zh
Disallow /de
Disallow /fr
Disallow /it

Other Records

Field Value
crawl-delay 30

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

applebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

ccbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

grapeshot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

zhanzhang

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

y!j*

Rule Path
Disallow /

y!j-srd/1.0

Rule Path
Disallow /

y!j-mbs/1.0

Rule Path
Disallow /

y!j-brw/1.0 crawler

Rule Path
Disallow /

y!j-brj/yats crawler

Rule Path
Disallow /

y!j-brl/yatss crawler

Rule Path
Disallow /

y!j-brm/yatsd crawler

Rule Path
Disallow /

y!j-brn/yatsa crawler

Rule Path
Disallow /

y!j-bry/yatsh crawler

Rule Path
Disallow /

y!j-brz/yatsha crawler

Rule Path
Disallow /

y!j-bri/0.0.1 crawler

Rule Path
Disallow /

yeti

Rule Path
Disallow /

pingdom.com_bot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

ias-va

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow