tsw.co.uk
robots.txt

Robots Exclusion Standard data for tsw.co.uk

Resource Scan

Scan Details

Site Domain tsw.co.uk
Base Domain tsw.co.uk
Scan Status Ok
Last Scan2025-11-18T01:26:26+00:00
Next Scan 2025-12-02T01:26:26+00:00

Last Scan

Scanned2025-11-18T01:26:26+00:00
URL https://tsw.co.uk/robots.txt
Domain IPs 104.26.0.219, 104.26.1.219, 172.67.71.194, 2606:4700:20::681a:1db, 2606:4700:20::681a:db, 2606:4700:20::ac43:47c2
Response IP 104.26.0.219
Found Yes
Hash 5074c382ce174cd4c8a29aaf9da2c61bf3ccef91b7fb390e550b8dbbbed5692c
SimHash 6987100acb81

Groups

ahrefsbot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /page_view_timing
Disallow /ajax
Disallow /metrics
Disallow /jserrors
Disallow /session_trace
Disallow /page_action
Disallow /spa
Disallow /page_view_event
Disallow /*?e-page
Disallow /*?utm_campaign=
Disallow /*?utm_content=
Disallow /*?hs_amp=true
Disallow /*?_hsenc=
Disallow /*%7BlocalLink%3A*
Disallow /*?post_type=*
Disallow /*?nocache=
Disallow /calendar/p/
Disallow /apprenticeships/apprenticeship-testimonials/
Disallow /apprenticeships/engineering/testimonials/
Disallow /testimonials/
Disallow /points-of-view/
Disallow /case-study-type/

Other Records

Field Value
sitemap https://www.tsw.co.uk/sitemap_index.xml

Comments

  • Allow Ahrefs
  • Main rules for everyone else
  • Block analytics and tracking endpoints
  • Block tracking & query parameters
  • Block low-value sections
  • Sitemap