digitalworkerbees.com
robots.txt
Robots Exclusion Standard data for digitalworkerbees.com
Resource Scan
Scan Details
| Site Domain | digitalworkerbees.com |
| Base Domain | digitalworkerbees.com |
| Scan Status | Ok |
| Last Scan | 2025-10-09T04:52:50+00:00 |
| Next Scan | 2025-10-16T04:52:50+00:00 |
Last Scan
| Scanned | 2025-10-09T04:52:50+00:00 |
| URL | https://digitalworkerbees.com/robots.txt |
| Domain IPs | 104.21.77.33, 172.67.204.1, 2606:4700:3032::6815:4d21, 2606:4700:3033::ac43:cc01 |
| Response IP | 104.21.77.33 |
| Found | Yes |
| Hash | c41415c29663ce6e26a8bbe43fab387975f22f70492721c658f345e1652d3522 |
| SimHash | 4ff860154313 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /app |
| Allow | /tools |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /xmlrpc.php |
| Allow | /tools/1 |
| Allow | /tools/2 |
| Allow | /tools/3 |
| Allow | /tools/4 |
| Allow | /tools/5 |
| Allow | /tools/6 |
| Allow | /tools/7 |
| Allow | /tools/8 |
| Allow | /tools/9 |
| Allow | /tools/10 |
| Allow | /tools/11 |
| Allow | /tools/12 |
| Allow | /tools/13 |
| Allow | /tools/14 |
| Allow | /tools/15 |
| Allow | /tools/16 |
| Allow | /tools/17 |
| Allow | /tools/18 |
| Allow | /tools/19 |
| Allow | /tools/20 |
| Allow | /tools/21 |
| Allow | /tools/22 |
| Allow | /tools/23 |
| Allow | /tools/24 |
| Allow | /tools/25 |
| Allow | /tools/26 |
| Allow | /tools/27 |
| Allow | /tools/28 |
| Allow | /tools/29 |
| Allow | /tools/30 |
| Allow | /tools/31 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://digitalworkerbees.com/sitemap.xml |
| sitemap | https://www.digitalworkerbees.com/sitemap.xml |
| sitemap | https://digitalworkerbees.com/tools/sitemap.xml |
| sitemap | https://www.digitalworkerbees.com/tools/sitemap.xml |