designcircus.co.kr
robots.txt

Robots Exclusion Standard data for designcircus.co.kr

Resource Scan

Scan Details

Site Domain designcircus.co.kr
Base Domain designcircus.co.kr
Scan Status Ok
Last Scan2024-10-04T04:42:10+00:00
Next Scan 2024-10-11T04:42:10+00:00

Last Scan

Scanned2024-10-04T04:42:10+00:00
URL https://designcircus.co.kr/robots.txt
Domain IPs 3.36.185.182
Response IP 3.36.185.182
Found Yes
Hash 2c290052fd15a0794542e0b39a09220e41e1fc8aefe283e5ca621cb2abde8e2e
SimHash a890ca14d203

Groups

*
googlebot

Rule Path
Allow /guide
Allow /project
Allow /designer
Allow /portfolio
Allow /member/login
Allow /member/new
Disallow /*.css$
Disallow /*.js$

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /guide
Allow /project
Allow /designer
Allow /portfolio
Allow /member/login
Allow /member/new
Disallow /*.css$
Disallow /*.js$

Other Records

Field Value
crawl-delay 1

naverbot

Rule Path
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.css$
Disallow /*.js$

Other Records

Field Value
crawl-delay 1

yeti

Rule Path
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.css$
Disallow /*.js$

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /