Log In Sign Up

brushwiz.com
robots.txt

Robots Exclusion Standard data for brushwiz.com

Resource Scan

Scan Details

Site Domain brushwiz.com
Base Domain brushwiz.com
Scan Status Ok
Last Scan2024-04-17T18:45:38+00:00
Next Scan 2024-05-17T18:45:38+00:00

Last Scan

Scanned2024-04-17T18:45:38+00:00
URL https://brushwiz.com/robots.txt
Redirect https://www.brushwiz.com/robots.txt
Redirect Domain www.brushwiz.com
Redirect Base brushwiz.com
Domain IPs 104.26.4.82, 104.26.5.82, 172.67.69.252, 2606:4700:20::681a:452, 2606:4700:20::681a:552, 2606:4700:20::ac43:45fc
Redirect IPs 104.26.4.82, 104.26.5.82, 172.67.69.252, 2606:4700:20::681a:452, 2606:4700:20::681a:552, 2606:4700:20::ac43:45fc
Response IP 104.26.5.82
Found Yes
Hash 917effe03e3fc6854785c2129406fb4cb68454592bd0d69a38507a95504d4dfe
SimHash 30104bda6dcb

Groups

*

Rule Path
Disallow /keywords
Disallow /account
Disallow /checkout
Disallow /cart
Disallow /full-index

Other Records

Field Value
crawl-delay 50

etaospider
ccbot
daum
webcrawler
archive.org_bot
semrushbot
ia_archiver
a6-indexer
abonti
adidxbot
adscanner
msiecrawler
baiduspider
mj12bot
voilabot

Rule Path
Disallow /
Back to top

Comments

  • BEGIN FILE
  • The use of robots or other automated means to access the BrushWiz site
  • without the express permission of BrushWiz is strictly prohibited.
  • Notwithstanding the foregoing, BrushWiz may permit automated access to
  • access certain BrushWiz pages but solely for the limited purpose of
  • including content in publicly available search engines. Any other
  • use of robots or failure to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly
  • prohibited.
  • Global robots.txt as of 2023-08-07
  • robots.txt for https://www.brushwiz.com
  • Block unnecessary robots
  • End robots.txt file
Back to top

Warnings

  • 1 invalid line.
Back to top