sarfend.co.uk
robots.txt
Robots Exclusion Standard data for sarfend.co.uk
Resource Scan
Scan Details
| Site Domain | sarfend.co.uk |
| Base Domain | sarfend.co.uk |
| Scan Status | Ok |
| Last Scan | 2026-04-08T02:41:20+00:00 |
| Next Scan | 2026-04-15T02:41:20+00:00 |
Last Scan
| Scanned | 2026-04-08T02:41:20+00:00 |
| URL | https://sarfend.co.uk/robots.txt |
| Domain IPs | 77.68.21.144 |
| Response IP | 77.68.21.144 |
| Found | Yes |
| Hash | 4278bb207b289b11511e5732654fa4b5298ef0a1fc5791df853e5f6033e2e6a2 |
| SimHash | feaec8f8ef6d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /aboutus.html |
| Disallow | /contact.html |
| Disallow | /problem.shtml |
| Disallow | /redirect.php |
| Disallow | /search.html |
| Disallow | /newsletter.html |
| Disallow | /terms.html |
| Disallow | /privacypolicy.html |
| Disallow | /weather/links.php |
| Disallow | /weather/astronomy.php |
| Disallow | /weather/history.php |
| Disallow | /weather/trends.php |
| Disallow | /weather/quake.php |
| Disallow | /weather/livemap.php |
| Disallow | /weather/status.php |
| Disallow | /weather/graphs.php |
| Disallow | /weather/uvforecast.php |
| Disallow | /weather/advisory.php |
| Disallow | /weather/sitemap.php |
| Disallow | /weather/gauges.htm |
| Disallow | /weather/index.htm |
| Disallow | /weather/trends.htm |
| Disallow | /weather/record.htm |
| Disallow | /forum/index.html |
| Disallow | /forum/forumhelp.html |
| Disallow | /wp-content/cache/ |
| Disallow | /category/* |
| Disallow | /comments/feed/ |
| Disallow | /comments/ |
| Disallow | /date/ |
| Disallow | /feed/ |
| Disallow | /labels/ |
| Disallow | /author/ |
| Disallow | /page/ |
| Disallow | /rss/ |
| Disallow | /tag/ |
| Disallow | /trackback/ |
| Disallow | /*/wp-content/cache/ |
| Disallow | /*/category/* |
| Disallow | /*/comments/feed/ |
| Disallow | /*/comments/ |
| Disallow | /*/date/ |
| Disallow | /*/feed/ |
| Disallow | /*/labels/ |
| Disallow | /*/page/ |
| Disallow | /*/rss/ |
| Disallow | /*/tag/ |
| Disallow | /*/trackback/ |
| Disallow | /weather/mobile/ |
| Disallow | /cgi-bin/survey/ |
| Disallow | /survey/ |
| Disallow | /lists/ |
| Disallow | /weather_old/ |
| Disallow | /weather/archive/ |
Comments