arthurjohnson.co.uk
robots.txt
Robots Exclusion Standard data for arthurjohnson.co.uk
Resource Scan
Scan Details
| Site Domain | arthurjohnson.co.uk |
| Base Domain | arthurjohnson.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-04-30T10:29:44+00:00 |
| Next Scan | 2025-05-30T10:29:44+00:00 |
Last Scan
| Scanned | 2025-04-30T10:29:44+00:00 |
| URL | https://arthurjohnson.co.uk/robots.txt |
| Redirect | https://www.arthurjohnson.co.uk/robots.txt |
| Redirect Domain | www.arthurjohnson.co.uk |
| Redirect Base | arthurjohnson.co.uk |
| Domain IPs | 104.21.48.186, 172.67.136.62, 2606:4700:3030::ac43:883e, 2606:4700:3034::6815:30ba |
| Redirect IPs | 104.21.48.186, 172.67.136.62, 2606:4700:3030::ac43:883e, 2606:4700:3034::6815:30ba |
| Response IP | 104.21.48.186 |
| Found | Yes |
| Hash | 1def01894ef66aa1b78aa2fb848bc18966630594b0042dc5df0edfad86b68894 |
| SimHash | 635e44020b9d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /manage/ |
| Disallow | /auctioneer/ |
| Disallow | /auctioneer_live/ |
| Disallow | /live_v2/ |
| Disallow | /components |
| Disallow | /components/ |
| Disallow | /components/catalogue_components.cfc |