Log In Sign Up

washerhelp.co.uk
robots.txt

Robots Exclusion Standard data for washerhelp.co.uk

Resource Scan

Scan Details

Site Domain washerhelp.co.uk
Base Domain washerhelp.co.uk
Scan Status Ok
Last Scan2026-01-22T17:36:08+00:00
Next Scan 2026-01-29T17:36:08+00:00

Last Scan

Scanned2026-01-22T17:36:08+00:00
URL https://washerhelp.co.uk/robots.txt
Domain IPs 34.149.36.179, 35.190.31.54, 35.227.194.51, 35.244.153.44
Response IP 34.160.81.203
Found Yes
Hash 9793d41bb8c16adc0c9c0ca112afc66583b8534dc97dae2884987b8fc763b68b
SimHash a9c009259de8

Groups

*

Rule Path
Disallow /forums/startTopic/
Disallow /forums/*?do=add
Disallow /forums/*?do=submit
Disallow /forums/discover/unread/
Disallow /forums/markallread/
Disallow /forums/staff/
Disallow /forums/online/
Disallow /forums/discover/
Disallow /forums/leaderboard/
Disallow /forums/search/
Disallow /forums/*?advancedSearchForm=
Disallow /forums/register/
Disallow /forums/lostpassword/
Disallow /forums/login/
Disallow /forums/*?sortby=
Disallow /forums/*?filter=
Disallow /forums/*?tab=comments
Disallow /forums/*?do=findComment
Disallow /forums/*?do=getLastComment
Disallow /forums/*?do=getNewComment
Disallow /forums/*?do=reportComment
Disallow /forums/*?do=markRead
Disallow /forums/profile/
Back to top

Other Records

Field Value
sitemap https://www.washerhelp.co.uk/forums/sitemap.php
Back to top

Comments

  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
  • Sitemap URL
Back to top