carview.yahoo.co.jp
robots.txt

Robots Exclusion Standard data for carview.yahoo.co.jp

Resource Scan

Scan Details

Site Domain carview.yahoo.co.jp
Base Domain yahoo.co.jp
Scan Status Ok
Last Scan2024-11-06T01:54:40+00:00
Next Scan 2024-12-06T01:54:40+00:00

Last Scan

Scanned2024-11-06T01:54:40+00:00
URL https://carview.yahoo.co.jp/robots.txt
Domain IPs 182.22.28.252
Response IP 182.22.16.123
Found Yes
Hash 624005d934d03fe0333890de9c190dd04775ebbe45d52f39db42f4a39fbb60c4
SimHash 4c1e5394e49b

Groups

*

Rule Path
Disallow /news/detail/*/comment/
Disallow /news/detail/*/photo/
Disallow /article/detail/*/comment/
Disallow /article/detail/*/photo/
Disallow /article/comment?method=getComment
Disallow /usedcar/condition/
Disallow /ncar/catalog/*/chiebukuro/question/post?
Disallow /ncar/catalog/*/chiebukuro/answer/post?
Disallow /article/countUp/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://carview.yahoo.co.jp/sitemaps/top.xml
sitemap https://carview.yahoo.co.jp/sitemaps/index_ucar.xml
sitemap https://carview.yahoo.co.jp/sitemaps/index_catalog.xml
sitemap https://carview.yahoo.co.jp/sitemaps/index_article.xml
sitemap https://carview.yahoo.co.jp/sitemaps/index_news.xml

Warnings

  • 2 invalid lines.