Log In Sign Up

archconf.com
robots.txt

Robots Exclusion Standard data for archconf.com

Resource Scan

Scan Details

Site Domain archconf.com
Base Domain archconf.com
Scan Status Ok
Last Scan2024-09-23T18:39:32+00:00
Next Scan 2024-09-30T18:39:32+00:00

Last Scan

Scanned2024-09-23T18:39:32+00:00
URL https://archconf.com/robots.txt
Domain IPs 159.89.252.226
Response IP 159.89.252.226
Found Yes
Hash 949b2a261fea1b71d1e4db4ef51773591340fcfd9247280b05e53bf290d32cf1
SimHash 12b56302ccb2

Groups

serpstatbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

cf-uc

Rule Path
Disallow /

buck

Rule Path
Disallow /

bubing

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

icarus6j

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

squider

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

prismatic

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

unwindfetchor

Rule Path
Disallow /

zemanta

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

tiptop

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

newslebot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexblogs
yandexbot
yandexfavicons
yandexmedia

Rule Path
Disallow /

moget

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

nextgensearchbot 1

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /n/data/

*

Rule Path
Disallow /n/order/

*

Rule Path
Allow /
Back to top