recipe-blog.jp
robots.txt
Robots Exclusion Standard data for recipe-blog.jp
Resource Scan
Scan Details
| Site Domain | recipe-blog.jp |
| Base Domain | recipe-blog.jp |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-02-26T21:27:04+00:00 |
| Next Scan | 2024-05-26T21:27:04+00:00 |
Last Successful Scan
| Scanned | 2023-02-01T20:04:05+00:00 |
| URL | https://recipe-blog.jp/robots.txt |
| Redirect | https://www.recipe-blog.jp:443/robots.txt |
| Redirect Domain | www.recipe-blog.jp |
| Redirect Base | recipe-blog.jp |
| Domain IPs | 13.227.254.110, 13.227.254.117, 13.227.254.124, 13.227.254.8 |
| Redirect IPs | 13.33.88.101, 13.33.88.122, 13.33.88.28, 13.33.88.73 |
| Response IP | 13.33.88.122 |
| Found | Yes |
| Hash | 9489c95ca4955fb8405de2406b67229bc5edca6dc33971ad7d02454ce67082f7 |
| SimHash | 7255dce3c931 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /manage/ |
| Disallow | /antenna_manage/ |
| Disallow | /cache/ |
| Disallow | /mypage/ |
| Disallow | /login |
| Disallow | /logout |
| Disallow | *.cgi |
| Disallow | *.fcgi |
| Disallow | /sp/form_post |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.recipe-blog.jp/sitemap/sitemap_index.xml |
| sitemap | http://www.recipe-blog.jp/sitemap_http/sitemap_index.xml |
Comments