Log In Sign Up

bsbinsider.com
robots.txt

Robots Exclusion Standard data for bsbinsider.com

Resource Scan

Scan Details

Site Domain bsbinsider.com
Base Domain bsbinsider.com
Scan Status Ok
Last Scan2026-03-20T17:16:46+00:00
Next Scan 2026-03-27T17:16:46+00:00

Last Scan

Scanned2026-03-20T17:16:46+00:00
URL https://bsbinsider.com/robots.txt
Redirect https://www.bsbinsider.com/robots.txt
Redirect Domain www.bsbinsider.com
Redirect Base bsbinsider.com
Domain IPs 69.163.168.196
Redirect IPs 69.163.168.196
Response IP 69.163.168.196
Found Yes
Hash d85b98ee8e4533c1c98978589fabc95a7f53afd4ca3a4a61b8f9b92ceffe7d78
SimHash 484ed8c0a113

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /wp-json/
Disallow /?rest_route=

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bsbinsider.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top