chintai-com.jp
robots.txt

Robots Exclusion Standard data for chintai-com.jp

Resource Scan

Scan Details

Site Domain chintai-com.jp
Base Domain chintai-com.jp
Scan Status Ok
Last Scan2024-08-30T13:31:40+00:00
Next Scan 2024-09-29T13:31:40+00:00

Last Scan

Scanned2024-08-30T13:31:40+00:00
URL https://chintai-com.jp/robots.txt
Redirect https://www.chintai-com.jp:443/robots.txt
Redirect Domain www.chintai-com.jp
Redirect Base chintai-com.jp
Domain IPs 13.33.88.102, 13.33.88.105, 13.33.88.119, 13.33.88.76
Redirect IPs 13.33.88.102, 13.33.88.105, 13.33.88.119, 13.33.88.76
Response IP 13.33.88.105
Found Yes
Hash 90ac32b42ceb7e2f7f205641a23b8cea8980fe19e5df7780733c15fa29593e89
SimHash 621f5450c301

Groups

*

Rule Path
Disallow /search/ajax/member_cnt/
Disallow /search/ajax/kodawaricount/
Disallow /search/ajax/today_cnt/
Disallow /search/ajax/public_cnt/
Disallow /search/ajax/all_cnt/
Disallow /search/ajax/condition/
Disallow /bkn/ajax/pv/
Disallow /search/ajax/bkncnt/
Disallow /mobile/search/bkncount/

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

twitterbot

Rule Path
Allow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

trovitbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

linespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

Other Records

Field Value
sitemap https://www.chintai-com.jp/sitemap.xml
sitemap https://www.chintai-com.jp/bknsitemap.xml
sitemap https://www.chintai-com.jp/bknsitemap2.xml
sitemap https://www.chintai-com.jp/bknsitemap3.xml
sitemap https://www.chintai-com.jp/bknsitemap4.xml
sitemap https://www.chintai-com.jp/blogsitemap.xml