reviews.co.uk
robots.txt
Robots Exclusion Standard data for reviews.co.uk
Resource Scan
Scan Details
Site Domain | reviews.co.uk |
Base Domain | reviews.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-13T06:35:48+00:00 |
Next Scan | 2024-10-13T06:35:48+00:00 |
Last Scan
Scanned | 2024-09-13T06:35:48+00:00 |
URL | https://reviews.co.uk/robots.txt |
Redirect | https://www.reviews.co.uk/robots.txt |
Redirect Domain | www.reviews.co.uk |
Redirect Base | reviews.co.uk |
Domain IPs | 104.18.30.161, 104.18.31.161, 2606:4700::6812:1ea1, 2606:4700::6812:1fa1 |
Redirect IPs | 104.18.30.161, 104.18.31.161, 2606:4700::6812:1ea1, 2606:4700::6812:1fa1 |
Response IP | 104.18.30.161 |
Found | Yes |
Hash | d504cd9eebf8a3561bd594280369cf3ed13c9f0bd39fd19e626afc71bdd3bb93 |
SimHash | 68cced72c7b0 |
Groups
*
Rule | Path |
---|---|
Disallow | /exit/* |
Disallow | /store/clickout/* |
Disallow | /search |
Disallow | /api/* |
Disallow | /demo-popup/* |
Disallow | /tracking/* |
Other Records
Field | Value |
---|---|
sitemap | http://www.reviews.co.uk/sitemap.xml |
sitemap | https://www.reviews.io/sitemap.xml |
sitemap | https://blog.reviews.io/sitemap |