shophunt.co.uk
robots.txt

Robots Exclusion Standard data for shophunt.co.uk

Resource Scan

Scan Details

Site Domain shophunt.co.uk
Base Domain shophunt.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-12T05:43:43+00:00
Next Scan 2024-09-10T05:43:43+00:00

Last Successful Scan

Scanned2024-01-22T05:41:42+00:00
URL https://shophunt.co.uk/robots.txt
Domain IPs 104.21.63.43, 172.67.143.18, 2606:4700:3033::6815:3f2b, 2606:4700:3034::ac43:8f12
Response IP 104.21.63.43
Found Yes
Hash ac9701d92448228e049ac94d1d9ae4bcb25ab62a7979ff5ac52c416c51c223b1
SimHash f000c802ebb2

Groups

*

Rule Path
Disallow /*?reviews-page=*
Disallow /*?*reviews-page=*