enosearcher.it
robots.txt

Robots Exclusion Standard data for enosearcher.it

Resource Scan

Scan Details

Site Domain enosearcher.it
Base Domain enosearcher.it
Scan Status Ok
Last Scan2024-10-02T13:51:59+00:00
Next Scan 2024-11-01T13:51:59+00:00

Last Scan

Scanned2024-10-02T13:51:59+00:00
URL https://enosearcher.it/robots.txt
Redirect https://www.enosearcher.it/robots.txt
Redirect Domain www.enosearcher.it
Redirect Base enosearcher.it
Domain IPs 185.242.180.113
Redirect IPs 185.242.180.113
Response IP 185.242.180.113
Found Yes
Hash 56c4c55b568c0aaa8e3f7a63bd660bf490d92cc2d4579536f3de2514181be0c5
SimHash 4a55d892c2b0

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /proxy/
Disallow /cta/

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

barkrowler

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

barkrowler/0.9

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

willybot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

storebot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pigafetta

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /