navitime.jp
robots.txt

Robots Exclusion Standard data for navitime.jp

Resource Scan

Scan Details

Site Domain navitime.jp
Base Domain navitime.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-18T04:32:06+00:00
Next Scan 2024-11-16T04:32:06+00:00

Last Successful Scan

Scanned2022-03-21T06:09:53+00:00
URL http://www.navitime.jp/robots.txt
Response IP 52.84.226.163
Found Yes
Hash 99dd7b0c2e691a19a1a514652e8a448ff31106fd81d0b36a31047e1829d3e34b
SimHash 08653ae4c252

Groups

docomo/2.0 i-robot(c10;tc)

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /jsky
Disallow /ezweb
Disallow /emobile

docomo/1.0/i-robot/c5/tc

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /jsky
Disallow /ezweb
Disallow /emobile

docomo/2.0 p900i(c100:tb) d2cbot(+http://listing-ads.d2c.ne.jp/crawler)

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /jsky
Disallow /ezweb
Disallow /emobile

softbankmobilesearch

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /ezweb
Disallow /emobile
Disallow /imode

y!j-srd

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /ezweb
Disallow /emobile
Disallow /imode

y!j-mbs

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /ezweb
Disallow /emobile
Disallow /imode

*

Rule Path
Disallow /smartphone
Disallow /willcom
Disallow /jsky
Disallow /ezweb
Disallow /emobile
Disallow /imode