drbeasleys.com
robots.txt

Robots Exclusion Standard data for drbeasleys.com

Resource Scan

Scan Details

Site Domain drbeasleys.com
Base Domain drbeasleys.com
Scan Status Ok
Last Scan2025-12-12T00:28:07+00:00
Next Scan 2025-12-26T00:28:07+00:00

Last Scan

Scanned2025-12-12T00:28:07+00:00
URL https://drbeasleys.com/robots.txt
Redirect https://www.drbeasleys.com/robots.txt
Redirect Domain www.drbeasleys.com
Redirect Base drbeasleys.com
Domain IPs 104.21.56.13, 172.67.175.174, 2606:4700:3031::ac43:afae, 2606:4700:3034::6815:380d
Redirect IPs 104.18.37.69, 172.64.150.187, 2606:4700:4408::ac40:96bb, 2a06:98c1:3100::6812:2545
Response IP 172.64.150.187
Found Yes
Hash 16b4276ef9ac7d5285e151f4a488c9fa5cc82ec3c7f1ac07abbd35a92fc1e24f
SimHash a560ce40c604

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

rogerbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-content/uploads/woo-import-export/

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots
  • WP Import Export Rule