Log In Sign Up

silvybrand.com
robots.txt

Robots Exclusion Standard data for silvybrand.com

Resource Scan

Scan Details

Site Domain silvybrand.com
Base Domain silvybrand.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-02T04:16:44+00:00
Next Scan 2024-10-09T04:16:44+00:00

Last Successful Scan

Scanned2024-09-24T04:15:26+00:00
URL https://silvybrand.com/robots.txt
Domain IPs 195.35.38.228, 2a02:4780:b:1061:0:30de:6aa1:2
Response IP 195.35.38.228
Found Yes
Hash 241912956e7e21f4590a1cb8732e175497926a6fccf89c14b4bf408af5dca592
SimHash 71a0d8406db8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-includes/js/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /tag/
Disallow /category/
Disallow /author/
Disallow /search/
Back to top

Other Records

Field Value
sitemap https://silvybrand.com/sitemap.xml
sitemap https://silvybrand.com/sitemap.html
Back to top

Comments

  • Block all bots from accessing the wp-admin area except for admin-ajax.php
  • Allow all bots to access important resources
  • Prevent indexing of common sensitive directories (optional)
  • Block indexing of duplicate or low-value pages
  • Specify the location of the XML sitemap for better indexing
  • Specify the location of the HTML sitemap for user accessibility (optional)
Back to top