swindon24.co.uk
robots.txt
Robots Exclusion Standard data for swindon24.co.uk
Resource Scan
Scan Details
Site Domain | swindon24.co.uk |
Base Domain | swindon24.co.uk |
Scan Status | Ok |
Last Scan | 2025-05-09T03:09:30+00:00 |
Next Scan | 2025-05-16T03:09:30+00:00 |
Last Scan
Scanned | 2025-05-09T03:09:30+00:00 |
URL | https://swindon24.co.uk/robots.txt |
Redirect | https://www.swindon24.co.uk/robots.txt |
Redirect Domain | www.swindon24.co.uk |
Redirect Base | swindon24.co.uk |
Domain IPs | 104.21.38.227, 172.67.140.61 |
Redirect IPs | 104.21.38.227, 172.67.140.61 |
Response IP | 104.21.38.227 |
Found | Yes |
Hash | 31eefa50c77c11231f5adf13f501310768144cdc7a230a7ca71b9005e4c41eac |
SimHash | b95dd2e5db50 |
Groups
*
Rule | Path |
---|---|
Disallow | /9348423_orig/ |
Disallow | /9348423_orig/ |
Disallow | /ad_970x250_v00/ |
Disallow | /20151015_142353/ |
Disallow | /12654375_1263851823629923_7188143771045686435_n/ |
Disallow | /12642844_1263851463629959_6343093890586365499_n/ |
Disallow | /dsc_1486/ |
Disallow | /dsc_1530/ |
Disallow | /dsc_1656/ |
Disallow | /dsc_1592/ |
Disallow | /dsc_1466/ |
Disallow | /dsc_1748/ |
Disallow | /dsc_1488/ |
Disallow | /ardour-recruitment/ |
Disallow | /monster-m/ |
Warnings
- `noindex` is not a known field.