censorwatch.co.uk
robots.txt

Robots Exclusion Standard data for censorwatch.co.uk

Resource Scan

Scan Details

Site Domain censorwatch.co.uk
Base Domain censorwatch.co.uk
Scan Status Ok
Last Scan2025-06-17T09:23:47+00:00
Next Scan 2025-06-24T09:23:47+00:00

Last Scan

Scanned2025-06-17T09:23:47+00:00
URL http://censorwatch.co.uk/robots.txt
Domain IPs 92.205.0.167
Response IP 92.205.0.167
Found Yes
Hash cacf7a167105c1e27830c7b30c676527c45f140c5b6c097d0ec65857b04a7a3f
SimHash e50d5444c110

Groups

*

Rule Path
Disallow /travel_history_summary/

Other Records

Field Value
sitemap http://www.censorwatch.co.uk/sitemap.xml