specstree.com
robots.txt
Robots Exclusion Standard data for specstree.com
Resource Scan
Scan Details
| Site Domain | specstree.com |
| Base Domain | specstree.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-15T17:33:03+00:00 |
| Next Scan | 2025-11-29T17:33:03+00:00 |
Last Successful Scan
| Scanned | 2025-10-07T21:57:06+00:00 |
| URL | https://specstree.com/robots.txt |
| Domain IPs | 13.233.35.78 |
| Response IP | 13.233.35.78 |
| Found | Yes |
| Hash | 9718276f438b7f1fff8155a16d72d82b6cdf13f664002e8c52a34efa3344a57d |
| SimHash | 69606f11c6f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /CVS |
| Disallow | /*.svn$ |
| Disallow | /*.idea$ |
| Disallow | /*.sql$ |
| Disallow | /*.tgz$ |
| Disallow | /admin/ |
| Disallow | /app/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /pkginfo/ |
| Disallow | /shell/ |
| Disallow | /var/ |
| Disallow | /api.php |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /get.php |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /README.txt |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /*?dir* |
| Disallow | /*?dir=desc |
| Disallow | /*?dir=asc |
| Disallow | /*?limit=all |
| Disallow | /*?mode* |
| Disallow | /*?SID= |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /catalogsearch/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /cgi-bin/ |
| Disallow | /cleanup.php |
| Disallow | /apc.php |
| Disallow | /memcache.php |
| Disallow | /phpinfo.php |
Comments