jbnews.com
robots.txt

Robots Exclusion Standard data for jbnews.com

Resource Scan

Scan Details

Site Domain jbnews.com
Base Domain jbnews.com
Scan Status Ok
Last Scan2024-05-24T12:38:36+00:00
Next Scan 2024-05-31T12:38:36+00:00

Last Scan

Scanned2024-05-24T12:38:36+00:00
URL https://jbnews.com/robots.txt
Redirect https://www.jbnews.com/robots.txt
Redirect Domain www.jbnews.com
Redirect Base jbnews.com
Domain IPs 49.50.174.225
Redirect IPs 115.85.178.242, 115.85.179.186
Response IP 115.85.179.186
Found Yes
Hash b9ba25c068a30252e2e95d32266ac6c91119ff00a150aafe45f719ffe40818ec
SimHash 6309f8c4c795

Groups

*

Rule Path
Disallow /admin/
Disallow /engine_yonhap/
Disallow /search_yonhap/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap http://www.jbnews.com/sitemap.xml