Log In Sign Up

silvybrand.com
robots.txt

Robots Exclusion Standard data for silvybrand.com

Resource Scan

Scan Details

Site Domain silvybrand.com
Base Domain silvybrand.com
Scan Status Ok
Last Scan2024-11-06T04:18:04+00:00
Next Scan 2024-11-13T04:18:04+00:00

Last Scan

Scanned2024-11-06T04:18:04+00:00
URL https://silvybrand.com/robots.txt
Domain IPs 173.211.81.11
Response IP 173.211.81.11
Found Yes
Hash 241912956e7e21f4590a1cb8732e175497926a6fccf89c14b4bf408af5dca592
SimHash 71a0d8406db8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-includes/js/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /tag/
Disallow /category/
Disallow /author/
Disallow /search/
Back to top

Other Records

Field Value
sitemap https://silvybrand.com/sitemap.xml
sitemap https://silvybrand.com/sitemap.html
Back to top

Comments

  • Block all bots from accessing the wp-admin area except for admin-ajax.php
  • Allow all bots to access important resources
  • Prevent indexing of common sensitive directories (optional)
  • Block indexing of duplicate or low-value pages
  • Specify the location of the XML sitemap for better indexing
  • Specify the location of the HTML sitemap for user accessibility (optional)
Back to top