tanenbaum.org
robots.txt
Robots Exclusion Standard data for tanenbaum.org
Resource Scan
Scan Details
| Site Domain | tanenbaum.org |
| Base Domain | tanenbaum.org |
| Scan Status | Ok |
| Last Scan | 2025-09-22T06:15:41+00:00 |
| Next Scan | 2025-10-22T06:15:41+00:00 |
Last Scan
| Scanned | 2025-09-22T06:15:41+00:00 |
| URL | https://tanenbaum.org/robots.txt |
| Domain IPs | 104.21.88.201, 172.67.152.162, 2606:4700:3030::ac43:98a2, 2606:4700:3035::6815:58c9 |
| Response IP | 172.67.152.162 |
| Found | Yes |
| Hash | acdf22392381d5ad952eaa8f84012a9727ad64aebce6832a8990f6aeadf60c58 |
| SimHash | 4ba88802ecbb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wc-logs/ |
| Disallow | /wp-content/uploads/woocommerce_transient_files/ |
| Disallow | /wp-content/uploads/woocommerce_uploads/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tanenbaum.org/sitemap_index.xml |
Comments