kankei.me
robots.txt

Robots Exclusion Standard data for kankei.me

Resource Scan

Scan Details

Site Domain kankei.me
Base Domain kankei.me
Scan Status Ok
Last Scan2024-05-22T15:05:18+00:00
Next Scan 2024-05-29T15:05:18+00:00

Last Scan

Scanned2024-05-22T15:05:18+00:00
URL http://kankei.me/robots.txt
Redirect https://toushi.kankei.me:443/robots.txt
Redirect Domain toushi.kankei.me
Redirect Base kankei.me
Domain IPs 54.64.200.156, 57.180.70.146
Redirect IPs 108.156.133.126, 108.156.133.22, 108.156.133.28, 108.156.133.55
Response IP 108.156.133.126
Found Yes
Hash 6f51f96449b171290b98036069404dee38843fb3b7ed77b96f97691988fcb0dd
SimHash 055c92208312

Groups

*

Rule Path
Disallow /docs/pdf/
Disallow /docs/tags/
Disallow /mailform.php
Disallow /d/*/viewer
Disallow /user/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider+

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /