m.dcinside.com
robots.txt

Robots Exclusion Standard data for m.dcinside.com

Resource Scan

Scan Details

Site Domain m.dcinside.com
Base Domain dcinside.com
Scan Status Ok
Last Scan2024-05-22T10:26:22+00:00
Next Scan 2024-06-21T10:26:22+00:00

Last Scan

Scanned2024-05-22T10:26:22+00:00
URL https://m.dcinside.com/robots.txt
Domain IPs 121.125.77.69
Response IP 121.125.77.69
Found Yes
Hash aa0ab6fc4a5ad63d65a0c914fa5b336bc42c6c2e23de4021e77b5e8d6acea668
SimHash c15852d57d70

Groups

*
googlebot

Rule Path
Disallow /gallog/tnwls232
Disallow /gallog/vubrkwe
Disallow /gallog/a7kim0413
Disallow /gallog/hankmj
Disallow /gallog/sksmsrjrhal
Disallow /gallog/kyeomhero
Disallow /gallog/aspjg6321
Disallow /api/
Disallow /board/47
Disallow /board/singo/
Disallow /board/stock_new/
Disallow /board/cat/
Disallow /board/dog/
Disallow /board/baseball_new
Disallow /board/baseball_new8
Disallow /board/m_entertainer1
Disallow /board/stock_new2
Disallow /board/ib_new
Disallow /board/d_fighter_new1
Disallow /board/produce48
Disallow /board/sportsseoul
Disallow /board/rezero
Disallow /board/starcraft/5179138
Disallow /board/comedy_new/3182480
Disallow /board/plastic_s/118703
Disallow /board/hajungwoo/12995
Disallow /board/hajungwoo/14508
Disallow /board/hajungwoo/14441
Disallow /board/hajungwoo/14977
Disallow /board/dongbang/43265
Disallow /board/dongbang/48008
Disallow /board/kimmyungmin/57241
Disallow /board/etc_entertainment1/1462322
Disallow /board/aion/231406
Disallow /board/aoa/455310
Disallow /board/government/3795671
Disallow /board/government/3795663
Disallow /board/government/3795664
Disallow /board/government/3795665
Disallow /board/government/3795657
Disallow /board/government/3795641
Disallow /board/arbeit/1781137
Disallow /board/arbeit/1854264
Disallow /board/arbeit/1827137
Disallow /board/arbeit/1902701
Disallow /board/theaterM/1062240
Disallow /board/immovables/1045608
Disallow /board/immovables/827440
Disallow /board/admission/1591805
Disallow /board/bigbang/107916
Disallow /board/exam_new/3441270
Disallow /board/metakr/
Disallow /board/salgoonews/

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

daum

Rule Path
Allow /

grapeshot

Rule Path
Allow /

yeti

Rule Path
Allow /