Log In Sign Up

rstbrands.com
robots.txt

Robots Exclusion Standard data for rstbrands.com

Resource Scan

Scan Details

Site Domain rstbrands.com
Base Domain rstbrands.com
Scan Status Ok
Last Scan2024-05-24T14:35:18+00:00
Next Scan 2024-06-23T14:35:18+00:00

Last Scan

Scanned2024-05-24T14:35:18+00:00
URL https://rstbrands.com/robots.txt
Redirect https://www.rstbrands.com/robots.txt
Redirect Domain www.rstbrands.com
Redirect Base rstbrands.com
Domain IPs 104.21.37.158, 172.67.210.85, 2606:4700:3030::6815:259e, 2606:4700:3035::ac43:d255
Redirect IPs 23.32.29.97, 23.32.29.98
Response IP 23.52.40.98
Found Yes
Hash e6664c69dfc0332eb05ca88455e960ed90adfeac8ecf6dbf5c07fa450c0fda35
SimHash 241ed614e9c8

Groups

semrushbot

Rule Path
Disallow

*

Rule Path
Disallow /segolily_catalog
Disallow /nationwide-contest-form
Disallow /erp/core/*
Disallow /c.1259219/rst-aconcagua/*
Disallow /orderform
Disallow /blog/author/*
Disallow /blog/category/*
Disallow /blog/tag/*
Disallow /*collections/*%2C*
Disallow /*category/*%2C*
Disallow /*search?*
Disallow /*frame-material/*?*
Disallow /*frame-option/*?
Disallow /*?**&*
Disallow /*?order=*
Disallow /*?display=*
Disallow /*?fabric-option=*
Disallow /*?frame-option=*
Disallow /*?layout=*
Back to top

Other Records

Field Value
sitemap https://www.rstbrands.com/sitemap_www.rstbrands.com_Index.xml
Back to top

Comments

  • Disallow: /app/platform/*
  • Disallow: /app/accounting/*
  • Disallow: /core/media/*
  • Block URLs with multiple query string parameters
  • Block URLs with specific parameter names (adjust as needed)
Back to top