bidbuy.co.kr
robots.txt

Robots Exclusion Standard data for bidbuy.co.kr

Resource Scan

Scan Details

Site Domain bidbuy.co.kr
Base Domain bidbuy.co.kr
Scan Status Ok
Last Scan2024-08-27T02:06:32+00:00
Next Scan 2024-09-26T02:06:32+00:00

Last Scan

Scanned2024-08-27T02:06:32+00:00
URL https://bidbuy.co.kr/robots.txt
Redirect https://www.bidbuy.co.kr/robots.txt
Redirect Domain www.bidbuy.co.kr
Redirect Base bidbuy.co.kr
Domain IPs 13.35.18.20, 13.35.18.34, 13.35.18.39, 13.35.18.56
Redirect IPs 13.35.18.20, 13.35.18.34, 13.35.18.39, 13.35.18.56
Response IP 13.35.18.34
Found Yes
Hash 9eb115b3ff35a096b5eef153108bc67ec330ecfae2819ee9a41ee98342f3f386
SimHash 511c5440cf81

Groups

semrushbot
semrushbot-sa
bingbot
scrapybot
serpstatbot
yandex
cincraw
bytespider
amazonbot
gptbot
applebot
claudebot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bidbuy.co.kr/sitemap.xml

Comments

  • DaumWebMasterTool:25bad65e3210b3ca2c20a7b951be4246fe5bf54f8fdf6c6dd4f7c18fc6f922c6:NF66jiJoFD7K2d+HzDe+Ag==