pet-friends.co.kr
robots.txt

Robots Exclusion Standard data for pet-friends.co.kr

Resource Scan

Scan Details

Site Domain pet-friends.co.kr
Base Domain pet-friends.co.kr
Scan Status Ok
Last Scan2024-05-27T21:19:34+00:00
Next Scan 2024-06-26T21:19:34+00:00

Last Scan

Scanned2024-05-27T21:19:34+00:00
URL https://www.pet-friends.co.kr/robots.txt
Redirect https://m.pet-friends.co.kr/robots.txt
Redirect Domain m.pet-friends.co.kr
Redirect Base pet-friends.co.kr
Domain IPs 18.155.68.22, 18.155.68.43, 18.155.68.86, 18.155.68.93
Redirect IPs 13.35.18.120, 13.35.18.32, 13.35.18.55, 13.35.18.56
Response IP 13.35.18.32
Found Yes
Hash c493b7bda07a74dde8a1a3596d25fe5f1da105fa4c15c6b7fcda0304f8141b2f
SimHash c9954702b792

Groups

*

Rule Path
Disallow /
Disallow /community/write/*
Disallow /community/update/*
Disallow /product/review/write
Disallow /main/tab/35

googlebot

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

googlebot-image

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

yeti

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

naverbot

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

daum

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

kakaotalk-scrap

Rule Path
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

Other Records

Field Value
sitemap https://m.pet-friends.co.kr/sitemap.xml
sitemap https://m.pet-friends.co.kr/server-sitemap.xml

Comments

  • *
  • Googlebot
  • Googlebot-image
  • Yeti
  • NaverBot
  • Daum
  • kakaotalk-scrap
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.