Log In Sign Up

trustedreviews.com
robots.txt

Robots Exclusion Standard data for trustedreviews.com

Resource Scan

Scan Details

Site Domain trustedreviews.com
Base Domain trustedreviews.com
Scan Status Ok
Last Scan2024-04-28T11:50:48+00:00
Next Scan 2024-05-05T11:50:48+00:00

Last Scan

Scanned2024-04-28T11:50:48+00:00
URL https://trustedreviews.com/robots.txt
Redirect https://www.trustedreviews.com/robots.txt
Redirect Domain www.trustedreviews.com
Redirect Base trustedreviews.com
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645
Response IP 199.232.46.133
Found Yes
Hash 470ae9721981c3dece0cb065fc7421906ce06f7c546f96da705bc46abe5f144f
SimHash cb809154e0af

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *?s=*
Disallow /search/*
Disallow /reviews?*period=
Disallow /reviews?s=
Disallow /reviews?*sorting=
Disallow /reviews?*product_type=
Disallow /reviews?*brands=
Disallow /guide?*period=
Disallow /guide?*&s=
Disallow /guide?*brands=
Disallow /guide?*product_type=
Disallow /recipes?s=
Disallow /recipes?*&s=
Disallow /recipes/?*&s=
Disallow /recipes/tag/*?s=
Disallow /recipes/tag/*/?s=
Disallow /recipes/tag/*?*&s=
Disallow /recipes/tag/*/?*&s=
Disallow /wp-json/*
Disallow /discount-codes/discount-codes/visit
Disallow /vouchers/vouchers/visit
Disallow */utils/*
Disallow */utils/definitions
Disallow */ChildVisitor
Disallow */ProxyVisitor
Disallow */encode
Disallow */decode
Disallow */definitions
Disallow */Message
Disallow */consent-string
Disallow */PlaceholderVisitor
Disallow /wp-content/plugins/keystone-taboola/assets/js/taboola.js*

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.trustedreviews.com/sitemap.xml
Back to top

Comments

  • Block search pages
  • Block review filter pages
  • Block guide filter pages
  • Block recipe filter pages
  • Block API
  • Block Vouchers
  • Block links within GTM JavaScript
  • Block Taboola Javascript
  • Sitemap archive
Back to top