joseilbo.co.kr
robots.txt

Robots Exclusion Standard data for joseilbo.co.kr

Resource Scan

Scan Details

Site Domain joseilbo.co.kr
Base Domain joseilbo.co.kr
Scan Status Ok
Last Scan2024-09-23T09:31:46+00:00
Next Scan 2024-09-30T09:31:46+00:00

Last Scan

Scanned2024-09-23T09:31:46+00:00
URL http://joseilbo.co.kr/robots.txt
Redirect http://www.joseilbo.co.kr:80/robots.txt
Redirect Domain www.joseilbo.co.kr
Redirect Base joseilbo.co.kr
Domain IPs 3.37.52.200, 43.202.78.156
Redirect IPs 3.37.52.200, 43.202.78.156
Response IP 3.37.52.200
Found Yes
Hash 0e66255b432aa12aac4e71e82bb323e8cdbcfe7849aaa19e12e3e3433355af0a
SimHash 492cd8f05742

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Common/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

googlebot

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

mediapartners-google

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /