petition.parliament.uk
robots.txt
Robots Exclusion Standard data for petition.parliament.uk
Resource Scan
Scan Details
Site Domain | petition.parliament.uk |
Base Domain | parliament.uk |
Scan Status | Ok |
Last Scan | 2024-06-28T13:52:39+00:00 |
Next Scan | 2024-07-28T13:52:39+00:00 |
Last Scan
Scanned | 2024-06-28T13:52:39+00:00 |
URL | https://petition.parliament.uk/robots.txt |
Domain IPs | 13.33.88.15, 13.33.88.56, 13.33.88.58, 13.33.88.70 |
Response IP | 13.33.88.70 |
Found | Yes |
Hash | 745af0107e5ff3364ec4cb76eb9a12b310e24ff7bd3a55c4912f94873cafeae6 |
SimHash | d0244c3ae952 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /admin/ |
Disallow | /browserconfig.xml |
Disallow | /feedback/thanks |
Disallow | /health-check |
Disallow | /manifest.json |
Disallow | /petitions/check |
Disallow | /petitions/check_results |
Disallow | /petitions/*/thank-you |
Disallow | /petitions/*/moderation-info |
Disallow | /petitions/*/sponsors/ |
Disallow | /petitions/*/signatures/ |
Disallow | /ping |
Disallow | /signatures/ |