peterfrancis.co.uk
robots.txt

Robots Exclusion Standard data for peterfrancis.co.uk

Resource Scan

Scan Details

Site Domain peterfrancis.co.uk
Base Domain peterfrancis.co.uk
Scan Status Ok
Last Scan2025-05-02T20:10:15+00:00
Next Scan 2025-06-01T20:10:15+00:00

Last Scan

Scanned2025-05-02T20:10:15+00:00
URL https://peterfrancis.co.uk/robots.txt
Domain IPs 104.21.22.139, 172.67.205.29, 2606:4700:3032::6815:168b, 2606:4700:3034::ac43:cd1d
Response IP 172.67.205.29
Found Yes
Hash 1def01894ef66aa1b78aa2fb848bc18966630594b0042dc5df0edfad86b68894
SimHash 635e44020b9d

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /manage/
Disallow /auctioneer/
Disallow /auctioneer_live/
Disallow /live_v2/
Disallow /components
Disallow /components/
Disallow /components/catalogue_components.cfc