m.chosun.com
robots.txt

Robots Exclusion Standard data for m.chosun.com

Resource Scan

Scan Details

Site Domain m.chosun.com
Base Domain chosun.com
Scan Status Ok
Last Scan2024-06-01T01:32:58+00:00
Next Scan 2024-07-01T01:32:58+00:00

Last Scan

Scanned2024-06-01T01:32:58+00:00
URL https://m.chosun.com/robots.txt
Domain IPs 13.124.162.250, 3.37.145.193
Response IP 3.37.145.193
Found Yes
Hash 0ef8e6e838161cf7294c15a5c54c8e0d5407fbbb00d2ba954b4b76eb84e3d3fd
SimHash 411443b77761

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

facebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /_b5_
Disallow /ad
Disallow /test

chatgpt-user

Rule Path
Disallow /