cheerup.jp
robots.txt

Robots Exclusion Standard data for cheerup.jp

Resource Scan

Scan Details

Site Domain cheerup.jp
Base Domain cheerup.jp
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-08T23:05:50+00:00
Next Scan 2024-12-07T23:05:50+00:00

Last Successful Scan

Scanned2022-10-22T17:07:51+00:00
URL http://cheerup.jp/robots.txt
Redirect http://english.cheerup.jp/robots.txt
Redirect Domain english.cheerup.jp
Redirect Base cheerup.jp
Response IP 18.179.238.150, 13.114.28.52
Found Yes
Hash 1ca9b8b9a26278b8ca63f9ecda2791e9f8e06caa89898e5859381163a4abc627
SimHash 27b2c80043e6

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

Comments

  • User-agent: *
  • Disallow: