nestle.jp
robots.txt
Robots Exclusion Standard data for nestle.jp
Resource Scan
Scan Details
| Site Domain | nestle.jp |
| Base Domain | nestle.jp |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-07T11:12:25+00:00 |
| Next Scan | 2024-12-06T11:12:25+00:00 |
Last Successful Scan
| Scanned | 2022-10-15T18:45:33+00:00 |
| URL | https://nestle.jp/robots.txt |
| Response IP | 104.18.18.195, 104.18.19.195 |
| Found | Yes |
| Hash | 559c42487ab0b5e9af9a0da5e2d2bb0d986a0d5b139b9c84636b778435e55244 |
| SimHash | 8c588828ea92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /nhshcp/member/product-info/material/ |
| Disallow | /smp/yahoo-signup/ |
| Disallow | /smp/yahoo-login/ |
| Disallow | /smp/twitter-signup/ |
| Disallow | /wellness-ambassador/food-check/ |
| Disallow | /smp/line-signup/ |
| Disallow | /smp/line-login/ |
| Disallow | /smp/twitter-login/ |
| Disallow | /smp/facebook-login/ |
| Disallow | /smp/facebook-signup/ |
| Disallow | /brand/purina/products/ajikirari.html |
| Disallow | /brand/kit/juken2021/yuriyan-voice/play/ |