parsers.vc
robots.txt
Robots Exclusion Standard data for parsers.vc
Resource Scan
Scan Details
Site Domain | parsers.vc |
Base Domain | parsers.vc |
Scan Status | Ok |
Last Scan | 2024-09-07T05:50:17+00:00 |
Next Scan | 2024-10-07T05:50:17+00:00 |
Last Scan
Scanned | 2024-09-07T05:50:17+00:00 |
URL | https://parsers.vc/robots.txt |
Domain IPs | 65.9.112.101, 65.9.112.109, 65.9.112.39, 65.9.112.63 |
Response IP | 65.9.112.101 |
Found | Yes |
Hash | 5603570f62365eda33c7b9503c2f7eb475ac74716d0c0dcc89dcdcc1ddb450ee |
SimHash | 4915cd004735 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /test/ |
Disallow | /editPage/ |
Disallow | /editFund/ |
Disallow | /addPage/ |
Warnings
- `host` is not a known field.