horseandhound.co.uk
robots.txt
Robots Exclusion Standard data for horseandhound.co.uk
Resource Scan
Scan Details
Site Domain | horseandhound.co.uk |
Base Domain | horseandhound.co.uk |
Scan Status | Ok |
Last Scan | 2024-06-07T15:53:51+00:00 |
Next Scan | 2024-06-14T15:53:51+00:00 |
Last Scan
Scanned | 2024-06-07T15:53:51+00:00 |
URL | https://horseandhound.co.uk/robots.txt |
Redirect | https://www.horseandhound.co.uk/robots.txt |
Redirect Domain | www.horseandhound.co.uk |
Redirect Base | horseandhound.co.uk |
Domain IPs | 34.241.23.183 |
Redirect IPs | 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114 |
Response IP | 199.232.46.114 |
Found | Yes |
Hash | 506c29a4f22548b6b1c8da37b38745df37f3ff7791cabff290b7565690e69ebf |
SimHash | dfa0f35560ef |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | *?s=* |
Disallow | /search/* |
Disallow | /reviews?*period= |
Disallow | /reviews?s= |
Disallow | /reviews?*sorting= |
Disallow | /reviews?*product_type= |
Disallow | /reviews?*brands= |
Disallow | /guide?*period= |
Disallow | /guide?*&s= |
Disallow | /guide?*brands= |
Disallow | /guide?*product_type= |
Disallow | /recipes?s= |
Disallow | /recipes?*&s= |
Disallow | /recipes/?*&s= |
Disallow | /recipes/tag/*?s= |
Disallow | /recipes/tag/*/?s= |
Disallow | /recipes/tag/*?*&s= |
Disallow | /recipes/tag/*/?*&s= |
Disallow | /wp-json/* |
Disallow | /discount-codes/discount-codes/visit |
Disallow | /vouchers/vouchers/visit |
Disallow | */utils* |
Disallow | */utils/definitions |
Disallow | */ChildVisitor |
Disallow | */ProxyVisitor |
Disallow | */encode |
Disallow | */decode |
Disallow | */definitions |
Disallow | */Message |
Disallow | */consent-string |
Disallow | */PlaceholderVisitor |
Disallow | */enums* |
Disallow | /wp-content/plugins/keystone-taboola/assets/js/taboola.js* |
Other Records
Field | Value |
---|---|
sitemap | https://www.horseandhound.co.uk/sitemap.xml |
Comments