boardcave.com
robots.txt
Robots Exclusion Standard data for boardcave.com
Resource Scan
Scan Details
| Site Domain | boardcave.com |
| Base Domain | boardcave.com |
| Scan Status | Ok |
| Last Scan | 2026-03-08T23:07:39+00:00 |
| Next Scan | 2026-04-07T23:07:39+00:00 |
Last Scan
| Scanned | 2026-03-08T23:07:39+00:00 |
| URL | https://boardcave.com/robots.txt |
| Redirect | https://www.boardcave.com/robots.txt |
| Redirect Domain | www.boardcave.com |
| Redirect Base | boardcave.com |
| Domain IPs | 104.26.6.102, 104.26.7.102, 172.67.72.164, 2606:4700:20::681a:666, 2606:4700:20::681a:766, 2606:4700:20::ac43:48a4 |
| Redirect IPs | 104.26.6.102, 104.26.7.102, 172.67.72.164, 2606:4700:20::681a:666, 2606:4700:20::681a:766, 2606:4700:20::ac43:48a4 |
| Response IP | 104.26.7.102 |
| Found | Yes |
| Hash | b3dd18b0098374018c2b244242fcdf74b2122e60b000dfebb2adfcd6cd63f122 |
| SimHash | cb14ccf3a2fb |
Groups
*
| Rule | Path |
|---|---|
| Allow | /reviews/surfboards$ |
| Allow | /reviews/surfboards/ |
| Allow | /reviews/surfboards?p= |
| Disallow | /reviews/surfboards*? |
| Disallow | /404/* |
| Disallow | /app/* |
| Disallow | /cgi-bin/* |
| Disallow | /downloader/* |
| Disallow | /errors/* |
| Disallow | /includes/* |
| Disallow | /magento/* |
| Disallow | /pkginfo/* |
| Disallow | /report/* |
| Disallow | /scripts/* |
| Disallow | /shell/* |
| Disallow | /stats/* |
| Disallow | /var/* |
| Disallow | /admin/* |
| Disallow | /index.php/ |
| Disallow | /catalog/product_compare/* |
| Disallow | /catalog/category/view/* |
| Disallow | /catalog/product/view/* |
| Disallow | /catalogsearch/ |
| Disallow | /control/* |
| Disallow | /contacts/* |
| Disallow | /customer/* |
| Disallow | /customize/* |
| Disallow | /newsletter/* |
| Disallow | /poll/* |
| Disallow | /review/ |
| Disallow | /sendfriend/* |
| Disallow | /tag/* |
| Disallow | /wishlist/* |
| Disallow | /catalog/product/gallery/* |
| Disallow | /sample-page/* |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /STATUS.txt |
| Disallow | /*.php$ |
| Disallow | /*?SID= |
| Disallow | /*/filter/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boardcave.com/sitemap.xml |
Comments