piapro.jp
robots.txt
Robots Exclusion Standard data for piapro.jp
Resource Scan
Scan Details
Site Domain | piapro.jp |
Base Domain | piapro.jp |
Scan Status | Ok |
Last Scan | 2024-11-01T09:29:46+00:00 |
Next Scan | 2024-11-08T09:29:46+00:00 |
Last Scan
Scanned | 2024-11-01T09:29:46+00:00 |
URL | https://piapro.jp/robots.txt |
Domain IPs | 153.120.102.132 |
Response IP | 153.120.102.132 |
Found | Yes |
Hash | 5070f5387f4cbd038e77ac1b49a679fcee873968120ea4d14908b0c7b3746115 |
SimHash | 24085170e7a1 |
Groups
*
Rule | Path |
---|---|
Disallow | /user_reg/ |
Disallow | /forgot_pw/ |
Disallow | /login/ |
Disallow | /mailto/ |
Disallow | /upload/ |
Disallow | /download/ |
Disallow | /upload_step/ |
Disallow | /upload_step2/ |
Disallow | /upload_step3/ |
Disallow | /upload_step4/ |
Disallow | /a/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |