swindon24.co.uk
robots.txt

Robots Exclusion Standard data for swindon24.co.uk

Resource Scan

Scan Details

Site Domain swindon24.co.uk
Base Domain swindon24.co.uk
Scan Status Ok
Last Scan2025-05-09T03:09:30+00:00
Next Scan 2025-05-16T03:09:30+00:00

Last Scan

Scanned2025-05-09T03:09:30+00:00
URL https://swindon24.co.uk/robots.txt
Redirect https://www.swindon24.co.uk/robots.txt
Redirect Domain www.swindon24.co.uk
Redirect Base swindon24.co.uk
Domain IPs 104.21.38.227, 172.67.140.61
Redirect IPs 104.21.38.227, 172.67.140.61
Response IP 104.21.38.227
Found Yes
Hash 31eefa50c77c11231f5adf13f501310768144cdc7a230a7ca71b9005e4c41eac
SimHash b95dd2e5db50

Groups

*

Rule Path
Disallow /9348423_orig/
Disallow /9348423_orig/
Disallow /ad_970x250_v00/
Disallow /20151015_142353/
Disallow /12654375_1263851823629923_7188143771045686435_n/
Disallow /12642844_1263851463629959_6343093890586365499_n/
Disallow /dsc_1486/
Disallow /dsc_1530/
Disallow /dsc_1656/
Disallow /dsc_1592/
Disallow /dsc_1466/
Disallow /dsc_1748/
Disallow /dsc_1488/
Disallow /ardour-recruitment/
Disallow /monster-m/

Warnings

  • `noindex` is not a known field.