san.chosun.com
robots.txt

Robots Exclusion Standard data for san.chosun.com

Resource Scan

Scan Details

Site Domain san.chosun.com
Base Domain chosun.com
Scan Status Ok
Last Scan2024-05-19T20:47:08+00:00
Next Scan 2024-06-18T20:47:08+00:00

Last Scan

Scanned2024-05-19T20:47:08+00:00
URL https://san.chosun.com/robots.txt
Domain IPs 115.85.177.164, 115.85.178.147
Response IP 115.85.177.164
Found Yes
Hash ee084a83c94eadf0900d6129ba3988261c86e15391954895f84e04f1a89f5288
SimHash 630db800c293

Groups

*

Rule Path
Disallow /admin/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://san.chosun.com/sitemap.xml