escualo.jp
robots.txt
Robots Exclusion Standard data for escualo.jp
Resource Scan
Scan Details
| Site Domain | escualo.jp |
| Base Domain | escualo.jp |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-08T19:48:55+00:00 |
| Next Scan | 2024-07-07T19:48:55+00:00 |
Last Successful Scan
| Scanned | 2021-08-18T16:17:58+00:00 |
| URL | https://escualo.jp/robots.txt |
| Found | Yes |
| Hash | 54847701743e230aab0e1b0b17a77d003c6bb289fd8bf65d36d10d7d319d95b7 |
| SimHash | a0152193f7f3 |
Groups
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.escualo.jp/sitemap.xml |
| sitemap | http://www.escualo.jp/sitemap.xml.gz |
Warnings
- 22 invalid lines.
- `user-agent` is not a known field.
Comments