joseilbo.kr
robots.txt

Robots Exclusion Standard data for joseilbo.kr

Resource Scan

Scan Details

Site Domain joseilbo.kr
Base Domain joseilbo.kr
Scan Status Ok
Last Scan2024-09-21T12:02:52+00:00
Next Scan 2024-09-28T12:02:52+00:00

Last Scan

Scanned2024-09-21T12:02:52+00:00
URL http://joseilbo.kr/robots.txt
Redirect http://www.joseilbo.com/robots.txt
Redirect Domain www.joseilbo.com
Redirect Base joseilbo.com
Domain IPs 3.37.52.200, 52.79.64.128
Redirect IPs 13.35.18.101, 13.35.18.21, 13.35.18.50, 13.35.18.70
Response IP 13.35.18.50
Found Yes
Hash 0e66255b432aa12aac4e71e82bb323e8cdbcfe7849aaa19e12e3e3433355af0a
SimHash 492cd8f05742

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Common/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

googlebot

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

mediapartners-google

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /