dailynewsonline.jp
robots.txt

Robots Exclusion Standard data for dailynewsonline.jp

Resource Scan

Scan Details

Site Domain dailynewsonline.jp
Base Domain dailynewsonline.jp
Scan Status Ok
Last Scan2024-10-29T15:54:07+00:00
Next Scan 2024-11-05T15:54:07+00:00

Last Scan

Scanned2024-10-29T15:54:07+00:00
URL https://dailynewsonline.jp/robots.txt
Domain IPs 13.33.88.104, 13.33.88.15, 13.33.88.2, 13.33.88.63
Response IP 13.33.88.104
Found Yes
Hash b6febcb79492b5da2011ab877e7943d24d1ee826ab96c26251768c54dc0added
SimHash 4540dc60ef90

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Warnings

  • 1 invalid line.
  • `host` is not a known field.