decanter.com
robots.txt
Robots Exclusion Standard data for decanter.com
Resource Scan
Scan Details
Site Domain | decanter.com |
Base Domain | decanter.com |
Scan Status | Ok |
Last Scan | 2024-11-13T22:06:23+00:00 |
Next Scan | 2024-11-20T22:06:23+00:00 |
Last Scan
Scanned | 2024-11-13T22:06:23+00:00 |
URL | https://decanter.com/robots.txt |
Redirect | https://www.decanter.com/robots.txt |
Redirect Domain | www.decanter.com |
Redirect Base | decanter.com |
Domain IPs | 45.223.122.77, 45.223.97.77 |
Redirect IPs | 45.223.107.77 |
Response IP | 45.223.107.77 |
Found | Yes |
Hash | 1b91e81a2e4b1974a6aae16d9f70d9337cde3a93d6fd4008583026679924d795 |
SimHash | dfa8b255e0ae |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | *?s=* |
Disallow | /search/* |
Disallow | /reviews?*period= |
Disallow | /reviews?s= |
Disallow | /reviews?*sorting= |
Disallow | /reviews?*product_type= |
Disallow | /reviews?*brands= |
Disallow | /guide?*period= |
Disallow | /guide?*&s= |
Disallow | /guide?*brands= |
Disallow | /guide?*product_type= |
Disallow | /recipes?s= |
Disallow | /recipes?*&s= |
Disallow | /recipes/?*&s= |
Disallow | /recipes/tag/*?s= |
Disallow | /recipes/tag/*/?s= |
Disallow | /recipes/tag/*?*&s= |
Disallow | /recipes/tag/*/?*&s= |
Disallow | /wp-json/* |
Disallow | /discount-codes/discount-codes/visit |
Disallow | /vouchers/vouchers/visit |
Disallow | */utils* |
Disallow | */utils/definitions |
Disallow | */ChildVisitor |
Disallow | */ProxyVisitor |
Disallow | */encode |
Disallow | */decode |
Disallow | */definitions |
Disallow | */Message |
Disallow | */consent-string |
Disallow | */PlaceholderVisitor |
Disallow | */enums* |
Disallow | /wp-content/plugins/keystone-taboola/assets/js/taboola.js* |
Other Records
Field | Value |
---|---|
sitemap | https://www.decanter.com/wp-sitemap.xml |
sitemap | https://www.decanter.com/sitemap.xml |
Comments