twizzletops.co.uk
robots.txt

Robots Exclusion Standard data for twizzletops.co.uk

Resource Scan

Scan Details

Site Domain twizzletops.co.uk
Base Domain twizzletops.co.uk
Scan Status Ok
Last Scan6/5/2025, 1:24:20 PM
Next Scan 7/5/2025, 1:24:20 PM

Last Scan

Scanned6/5/2025, 1:24:20 PM
URL https://twizzletops.co.uk/robots.txt
Domain IPs 104.21.91.44, 172.67.210.50, 2606:4700:3031::6815:5b2c, 2606:4700:3035::ac43:d232
Response IP 172.67.210.50
Found Yes
Hash 28704d34443ad4058e5b9d052b3a7e78dc960907390e1dd62bbda64d0cbd3356
SimHash 4000db124711

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow