Log In Sign Up

redsift.com
robots.txt

Robots Exclusion Standard data for redsift.com

Resource Scan

Scan Details

Site Domain redsift.com
Base Domain redsift.com
Scan Status Ok
Last Scan2025-08-23T20:41:23+00:00
Next Scan 2025-09-22T20:41:23+00:00

Last Scan

Scanned2025-08-23T20:41:23+00:00
URL https://redsift.com/robots.txt
Domain IPs 13.35.202.116, 13.35.202.16, 13.35.202.2, 13.35.202.64, 2600:9000:2078:3e00:11:419b:5700:93a1, 2600:9000:2078:4800:11:419b:5700:93a1, 2600:9000:2078:4e00:11:419b:5700:93a1, 2600:9000:2078:8e00:11:419b:5700:93a1, 2600:9000:2078:9600:11:419b:5700:93a1, 2600:9000:2078:dc00:11:419b:5700:93a1, 2600:9000:2078:ec00:11:419b:5700:93a1, 2600:9000:2078:f800:11:419b:5700:93a1
Response IP 13.35.202.116
Found Yes
Hash 1d8c483948f35ed38414d67d1ffe76f2437f12fa67c2bf68a6677afd520e84e5
SimHash 2e11611f4e88

Groups

*

Rule Path Comment
Disallow /*? -
Disallow /legal/* -
Disallow /email-subscription-center -
Disallow /trial-extension -
Disallow /landing -
Disallow /lp/ -
Disallow /cookie-declaration -
Disallow /company/events/* -
Allow /tools/bimi$ -
Allow /tools/bimi/$ -
Disallow /tools/bimi/ -
Allow /tools/spf-checker$ -
Allow /tools/spf-checker/$ -
Disallow /tools/spf-checker/ -
Disallow /tools/investigate/dmarc-checker block page not released yet
Disallow /tools/investigate/vid block page not released yet
Disallow /tools/investigate2 block page not released yet
Disallow /testing -
Disallow /test-page/* -
Disallow /competitive-guides/test-competitive-guide/ -
Disallow /products/test-product-page -
Disallow /guides/test-guide/ -
Disallow /guides/test-guides/ -
Disallow /guides/test-email-security-guide/ -
Disallow /guides/test-page-guide/ -
Disallow /partners/test-partner-portal -
Disallow /*.pdf$ -
Back to top

Other Records

Field Value
sitemap https://redsift.com/sitemap.xml
Back to top

Comments

  • amended 17 March 2025
  • Blocks All URLs with Query Parameters, Blocking parameters that don’t add unique content (like tracking parameters) helps keep the indexed pages clean and canonical, which can improve SEO
  • Do not block any language pages in robots.txt
  • All foreign language pages are blocked using noindex other than selected translated ones
  • to avoid indexing domain names like /tools/bimi/testing.com
  • to avoid indexing domain names like /tools/spf-checker/testing.com
  • Block below used for testing
  • Blocked because Page Guide maps to /guides and these are tests
  • Block indexing of pdf files
Back to top