britishplacenames.uk
robots.txt
Robots Exclusion Standard data for britishplacenames.uk
Resource Scan
Scan Details
Site Domain | britishplacenames.uk |
Base Domain | britishplacenames.uk |
Scan Status | Ok |
Last Scan | 2024-11-12T22:39:04+00:00 |
Next Scan | 2024-11-19T22:39:04+00:00 |
Last Scan
Scanned | 2024-11-12T22:39:04+00:00 |
URL | https://britishplacenames.uk/robots.txt |
Domain IPs | 104.21.17.146, 172.67.176.216, 2606:4700:3031::ac43:b0d8, 2606:4700:3037::6815:1192 |
Response IP | 172.67.176.216 |
Found | Yes |
Hash | 1a6b54d48236fa8e6d091efb07546045dd19eb0c259999a1e8021398aeae5bbf |
SimHash | 79051d40e5d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /bfx |
Disallow | /bfx/ |
Disallow | /search |
Disallow | /search/ |
Disallow | /handlers/ |
Other Records
Field | Value |
---|---|
sitemap | https://britishplacenames.uk/sitemap.xml |