buylsdonline.io
robots.txt

Robots Exclusion Standard data for buylsdonline.io

Resource Scan

Scan Details

Site Domain buylsdonline.io
Base Domain buylsdonline.io
Scan Status Ok
Last Scan2025-04-08T22:26:46+00:00
Next Scan 2025-05-08T22:26:46+00:00

Last Scan

Scanned2025-04-08T22:26:46+00:00
URL https://buylsdonline.io/robots.txt
Domain IPs 104.21.68.168, 172.67.197.59, 2606:4700:3036::6815:44a8, 2606:4700:3037::ac43:c53b
Response IP 104.21.68.168
Found Yes
Hash 4f1b94d03732a4866adcb161315fa0b874fe8a363dcae8f2be8c7e92399cb30a
SimHash 6415cb4047df

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpforms/
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /feed/
Disallow /comments/
Disallow /category/*/feed/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /?s=*
Disallow /*add-to-cart%3D*

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

badbot

Rule Path
Disallow /

*

Rule Path
Disallow /images/

Other Records

Field Value
sitemap https://buylsdonline.io/sitemap_index.xml
sitemap https://buylsdonline.io/page-sitemap.xml
sitemap https://buylsdonline.io/product-sitemap.xml
sitemap https://buylsdonline.io/post-sitemap.xml

Comments

  • Block all bots from accessing sensitive parts of the website
  • Allow Googlebot to access everything (modify as needed)
  • Block specific bots or crawlers
  • Prevent image scrapers