mikle.jp
robots.txt

Robots Exclusion Standard data for mikle.jp

Resource Scan

Scan Details

Site Domain mikle.jp
Base Domain mikle.jp
Scan Status Ok
Last Scan2024-09-17T23:40:16+00:00
Next Scan 2024-09-24T23:40:16+00:00

Last Scan

Scanned2024-09-17T23:40:16+00:00
URL https://mikle.jp/robots.txt
Domain IPs 52.197.132.220, 54.248.104.142
Response IP 54.248.104.142
Found Yes
Hash adac37f864df318d9c2d674305f308ad6a100592f15ced50a93e823412e000e0
SimHash cb12490a6721

Groups

*

Rule Path
Disallow /profile/*
Disallow /mypage/*
Disallow /mythread/*
Disallow /thread/post/*
Disallow /thread/postres/*
Disallow /threadres/post/*
Disallow /threadres/postres/*
Disallow /penalty/*
Disallow /premium/*
Disallow /auth/*
Disallow /dispmythread.cgi
Disallow /dropresreqpre.cgi
Disallow /dropthreqpre.cgi
Disallow /checkmem_ez.cgi
Disallow /respre.cgi
Disallow /ganbare/profile/*
Disallow /ganbare/mythread/*
Disallow /ganbare/thread/post/*
Disallow /ganbare/thread/postres/*
Disallow /ganbare/threadres/post/*
Disallow /ganbare/threadres/postres/*
Disallow /ganbare/penalty/*
Disallow /ganbare/premium/*
Disallow /ganbare/auth/*
Disallow /ganbare/dispmythread.cgi
Disallow /ganbare/dropresreqpre.cgi
Disallow /ganbare/dropthreqpre.cgi
Disallow /ganbare/checkmem_ez.cgi
Disallow /ganbare/respre.cgi

applebot
ise crawler
amazonbot
bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3