papimo.jp
robots.txt
Robots Exclusion Standard data for papimo.jp
Resource Scan
Scan Details
Site Domain | papimo.jp |
Base Domain | papimo.jp |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-23T01:27:22+00:00 |
Next Scan | 2024-07-22T01:27:22+00:00 |
Last Successful Scan
Scanned | 2023-06-29T01:22:16+00:00 |
URL | https://papimo.jp/robots.txt |
Domain IPs | 18.176.175.214, 52.199.74.204 |
Response IP | 18.176.175.214 |
Found | Yes |
Hash | 0715ed63ec573af7c03b2db85def3f722626176f8d323af30e58b5047d2b2b23 |
SimHash | 4250d8664601 |
Groups
*
Rule | Path |
---|---|
Disallow | /pc/ |
Disallow | /ps/ |
Disallow | /sw/ |
Disallow | /cl/ |
Disallow | /suppot/ |
Disallow | /image/ |
Disallow | /machinedatas/ |
Allow | /pc |
Allow | /ps |
Allow | /sw |
Allow | /cl |
Allow | /machinedatas/top/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |