mstauctioneers.co.uk
robots.txt

Robots Exclusion Standard data for mstauctioneers.co.uk

Resource Scan

Scan Details

Site Domain mstauctioneers.co.uk
Base Domain mstauctioneers.co.uk
Scan Status Ok
Last Scan2025-12-13T18:15:19+00:00
Next Scan 2026-01-12T18:15:19+00:00

Last Scan

Scanned2025-12-13T18:15:19+00:00
URL https://mstauctioneers.co.uk/robots.txt
Redirect https://www.mstauctioneers.co.uk/robots.txt
Redirect Domain www.mstauctioneers.co.uk
Redirect Base mstauctioneers.co.uk
Domain IPs 172.165.70.159
Redirect IPs 172.165.70.159
Response IP 172.165.70.159
Found Yes
Hash 1def01894ef66aa1b78aa2fb848bc18966630594b0042dc5df0edfad86b68894
SimHash 635e44020b9d

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /manage/
Disallow /auctioneer/
Disallow /auctioneer_live/
Disallow /live_v2/
Disallow /components
Disallow /components/
Disallow /components/catalogue_components.cfc