help-and-advice.britishnewspaperarchive.co.uk
robots.txt
Robots Exclusion Standard data for help-and-advice.britishnewspaperarchive.co.uk
Resource Scan
Scan Details
Site Domain | help-and-advice.britishnewspaperarchive.co.uk |
Base Domain | britishnewspaperarchive.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-25T04:35:10+00:00 |
Next Scan | 2024-10-25T04:35:10+00:00 |
Last Scan
Scanned | 2024-09-25T04:35:10+00:00 |
URL | https://help-and-advice.britishnewspaperarchive.co.uk/robots.txt |
Domain IPs | 104.17.27.92, 104.17.28.92, 104.17.29.92, 104.17.30.92, 104.17.31.92, 2606:4700::6811:1b5c, 2606:4700::6811:1c5c, 2606:4700::6811:1d5c, 2606:4700::6811:1e5c, 2606:4700::6811:1f5c |
Response IP | 104.17.31.92 |
Found | Yes |
Hash | 28aa87457557ddce43a5a7080deed74eb5ececfcdce2244791acdee03046d9e2 |
SimHash | 875a0f11dce5 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /admin/ |
Disallow | /dashboard/ |
Disallow | /assets/ |
Warnings
- 2 invalid lines.
Comments