m.hidoc.co.kr
robots.txt

Robots Exclusion Standard data for m.hidoc.co.kr

Resource Scan

Scan Details

Site Domain m.hidoc.co.kr
Base Domain hidoc.co.kr
Scan Status Ok
Last Scan2024-05-30T15:21:06+00:00
Next Scan 2024-06-29T15:21:06+00:00

Last Scan

Scanned2024-05-30T15:21:06+00:00
URL https://m.hidoc.co.kr/robots.txt
Redirect https://src.hidoc.co.kr/robots.txt
Redirect Domain src.hidoc.co.kr
Redirect Base hidoc.co.kr
Domain IPs 125.209.206.12
Redirect IPs 125.209.206.12
Response IP 125.209.206.12
Found Yes
Hash 244f3fa0d1ffb36531fed70e7f67d298e20004b723df97cb9651725c8b4c2918
SimHash ca2cc460b613

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

flamingo_searchengine+(+http://www.flamingosearch.com/bot)

Rule Path
Disallow /

netestate ne crawler (+http://www.website-datenbank.de/)

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

python-urllib/2.7

Rule Path
Disallow /

python-urllib/3.8

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

headlesschrome

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

*

Rule Path
Disallow /pro/
Disallow /adcenter/
Disallow /login/
Disallow /cowork/
Disallow /find/result/view/H0000155654
Disallow /integratesearch/

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://src.hidoc.co.kr/sitemap.xml