findby.co.kr
robots.txt

Robots Exclusion Standard data for findby.co.kr

Resource Scan

Scan Details

Site Domain findby.co.kr
Base Domain findby.co.kr
Scan Status Ok
Last Scan2024-10-04T17:01:23+00:00
Next Scan 2024-10-11T17:01:23+00:00

Last Scan

Scanned2024-10-04T17:01:23+00:00
URL https://findby.co.kr/robots.txt
Domain IPs 203.245.30.79
Response IP 203.245.30.79
Found Yes
Hash a2dc4993ea4d7b3b95607fa805bd834c350871b4acf1178460e51637200c1584
SimHash 005cc05becf2

Groups

*

Rule Path
Allow /

yandex
yandex
mj12bot
mj12bot
bytespider
bytespider
baiduspider
baiduspider
chinamobile
hetzner
alibaba
tencent
huawei
blexbot/1.0
dataforseobot/1.0
dotbot/1.2

Rule Path
Disallow /

Other Records

Field Value
sitemap https://findby.co.kr/sitemap_index.xml

Comments

  • User-agent: claudebot/1.0
  • User-agent: meta-externalagent/1.1
  • User-agent: meta-externalfetcher/1.1
  • User-agent: Amazonbot
  • DaumWebMasterTool:19f40a70ac724323160efbd7edfc8e34a27b848cfc0f8f8d40eab7bc2c59b52c:3RcKnm7DHskbMnuf6V3ORA==
  • Accept-Language: ko-KR
  • Please refer to our terms of service at https://findby.co.kr/terms-of-use.html for more details.