pet-friends.co.kr
robots.txt

Robots Exclusion Standard data for pet-friends.co.kr

Resource Scan

Scan Details

Site Domain pet-friends.co.kr
Base Domain pet-friends.co.kr
Scan Status Ok
Last Scan2024-09-24T21:20:11+00:00
Next Scan 2024-10-24T21:20:11+00:00

Last Scan

Scanned2024-09-24T21:20:11+00:00
URL https://www.pet-friends.co.kr/robots.txt
Redirect https://m.pet-friends.co.kr/robots.txt
Redirect Domain m.pet-friends.co.kr
Redirect Base pet-friends.co.kr
Domain IPs 18.65.229.115, 18.65.229.121, 18.65.229.128, 18.65.229.82
Redirect IPs 13.35.18.120, 13.35.18.32, 13.35.18.55, 13.35.18.56
Response IP 13.35.18.120
Found Yes
Hash 2aa0b361276c393967939960d6bb0ba6c51e871c3c3b01d3382cf1bcd181d2d7
SimHash c9d557023f92

Groups

*

Rule Path
Disallow /community/write/*
Disallow /community/update/*
Disallow /product/review/write
Disallow /main/tab/35
Disallow /cart
Disallow /v2/order/*
Disallow /benefit/*

googlebot

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

googlebot-image

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

yeti

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

naverbot

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

daum

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

kakaotalk-scrap

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

Other Records

Field Value
sitemap https://m.pet-friends.co.kr/sitemap.xml
sitemap https://m.pet-friends.co.kr/server-sitemap.xml

Comments

  • *
  • Googlebot
  • Googlebot-image
  • Yeti
  • NaverBot
  • Daum
  • kakaotalk-scrap
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.