Log In Sign Up

partzone.co.kr
robots.txt

Robots Exclusion Standard data for partzone.co.kr

Resource Scan

Scan Details

Site Domain partzone.co.kr
Base Domain partzone.co.kr
Scan Status Ok
Last Scan2024-10-01T02:31:58+00:00
Next Scan 2024-10-15T02:31:58+00:00

Last Scan

Scanned2024-10-01T02:31:58+00:00
URL https://partzone.co.kr/robots.txt
Domain IPs 211.251.246.104
Response IP 211.251.246.104
Found Yes
Hash 6335fbdbba3e3e021b6d0ad5c3862a2afd323121e25fa2c94edb8ba08bf1f7e5
SimHash 793ccc905e85

Groups

*

Rule Path
Disallow /myPage
Disallow /reservation
Disallow /zendesk
Disallow /packageList
Disallow /part/list
Disallow /business
Disallow /board
Disallow /shop
Disallow /auth
Disallow /mypage
Disallow /cart
Disallow /board
Disallow /signup
Disallow /signin
Disallow /api

googlebot

Rule Path
Allow /shop
Allow /cart
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.css$
Disallow /*.js$
Disallow /register/
Disallow /myPage
Disallow /reservation
Disallow /zendesk
Disallow /packageList
Disallow /part/list
Disallow /business
Disallow /board
Disallow /auth
Disallow /mypage
Disallow /board
Disallow /signup
Disallow /signin

Other Records

Field Value
crawl-delay 2

mediapartners-google

Rule Path
Allow /shop
Allow /cart
Disallow /register/
Disallow /myPage
Disallow /reservation
Disallow /zendesk
Disallow /packageList
Disallow /part/list
Disallow /business
Disallow /board
Disallow /auth
Disallow /mypage
Disallow /board
Disallow /signup
Disallow /signin

Other Records

Field Value
crawl-delay 2

naverbot

Rule Path
Allow /shop
Allow /cart
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.css$
Disallow /*.js$
Disallow /register/
Disallow /myPage
Disallow /reservation
Disallow /zendesk
Disallow /packageList
Disallow /part/list
Disallow /business
Disallow /board
Disallow /auth
Disallow /mypage
Disallow /board
Disallow /signup
Disallow /signin

Other Records

Field Value
crawl-delay 2

yeti

Rule Path
Allow /shop
Allow /cart
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.css$
Disallow /*.js$
Disallow /register/
Disallow /myPage
Disallow /reservation
Disallow /zendesk
Disallow /packageList
Disallow /part/list
Disallow /business
Disallow /board
Disallow /auth
Disallow /mypage
Disallow /board
Disallow /signup
Disallow /signin

Other Records

Field Value
crawl-delay 2

domainappender

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

Product Comment
blexbot http://webmeup-crawler.com/

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

Product Comment
dotbot https://moz.com/researchtools/ose/dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

rogerbot

Product Comment
rogerbot https://moz.com/help/guides/moz-procedures/what-is-rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

Product Comment
semrushbot https://www.semrush.com/bot/

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Product Comment
yandex https://yandex.com/support/webmaster/controlling-robot/robots-txt.html

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

Product Comment
mj12bot http://mj12bot.com/ - UK search engine

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

spbot

Product Comment
spbot http://openlinkprofiler.org/bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

Product Comment
pinterest https://help.pinterest.com/en/articles/about-pinterest-crawler-0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seznambot

Product Comment
seznambot http://www.botreports.com/user-agent/seznambot.shtml

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

istellabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ntentbot

Product Comment
ntentbot http://www.ntent.com/ntentbot/
Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.partzone.co.kr/sitemap.xml
Back to top

Comments

  • PC
  • Mobile
  • in case
  • Crawl Delay 10 bots
  • Crawl Delay 20 bots
  • Don't allow these bots to crawl the site. Ensure a rule exists in nginx locations config to block them too
Back to top