m.pet-friends.co.kr
robots.txt

Robots Exclusion Standard data for m.pet-friends.co.kr

Resource Scan

Scan Details

Site Domain m.pet-friends.co.kr
Base Domain pet-friends.co.kr
Scan Status Ok
Last Scan2024-11-17T22:13:55+00:00
Next Scan 2024-12-01T22:13:55+00:00

Last Scan

Scanned2024-11-17T22:13:55+00:00
URL https://m.pet-friends.co.kr/robots.txt
Domain IPs 18.155.68.13, 18.155.68.32, 18.155.68.39, 18.155.68.51
Response IP 18.155.68.51
Found Yes
Hash 2aa0b361276c393967939960d6bb0ba6c51e871c3c3b01d3382cf1bcd181d2d7
SimHash c9d557023f92

Groups

*

Rule Path
Disallow /community/write/*
Disallow /community/update/*
Disallow /product/review/write
Disallow /main/tab/35
Disallow /cart
Disallow /v2/order/*
Disallow /benefit/*

googlebot

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

googlebot-image

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

yeti

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

naverbot

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

daum

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

kakaotalk-scrap

Rule Path
Allow /
Allow /favicon/*
Allow /main/*
Allow /product/*
Allow /category/*
Allow /community/*
Allow /search
Allow /search/*
Allow /welcome-deal/*

Other Records

Field Value
sitemap https://m.pet-friends.co.kr/sitemap.xml
sitemap https://m.pet-friends.co.kr/server-sitemap.xml

Comments

  • *
  • Googlebot
  • Googlebot-image
  • Yeti
  • NaverBot
  • Daum
  • kakaotalk-scrap
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.