botreetechnologies.com
robots.txt
Robots Exclusion Standard data for botreetechnologies.com
Resource Scan
Scan Details
| Site Domain | botreetechnologies.com |
| Base Domain | botreetechnologies.com |
| Scan Status | Ok |
| Last Scan | 2024-08-26T16:59:51+00:00 |
| Next Scan | 2024-09-25T16:59:51+00:00 |
Last Scan
| Scanned | 2024-08-26T16:59:51+00:00 |
| URL | https://botreetechnologies.com/robots.txt |
| Redirect | https://www.botreetechnologies.com/robots.txt |
| Redirect Domain | www.botreetechnologies.com |
| Redirect Base | botreetechnologies.com |
| Domain IPs | 104.21.71.245, 172.67.172.102, 2606:4700:3033::ac43:ac66, 2606:4700:3035::6815:47f5 |
| Redirect IPs | 104.21.71.245, 172.67.172.102, 2606:4700:3033::ac43:ac66, 2606:4700:3035::6815:47f5 |
| Response IP | 104.21.71.245 |
| Found | Yes |
| Hash | e9bef06cb30276a0902147ae110bf252e108a7bf27d1cfe1cbc4a6d962162a5a |
| SimHash | b965ca028d95 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /apps/ |
| Disallow | /pdf/ |
| Disallow | /bspr2d/ |
| Disallow | /solutions/ |
| Disallow | /case-study/ |
| Disallow | /case-study-pdf/* |
| Disallow | /blog-new-theme/* |
| Disallow | /blog/tag/* |
| Disallow | /feed/ |
| Disallow | */feed/ |
| Disallow | /chat/ |
| Disallow | /dev/ |
| Disallow | /new/ |
| Disallow | /offerings/ |
| Disallow | /demo-blog/ |
| Disallow | /Website_2016/ |
| Disallow | /Website_2017/ |
| Disallow | /redesign_2017/ |
| Disallow | /advowire-responsive/ |
| Disallow | /TomWilsonProperties/ |
| Disallow | /theseomonkey/ |
| Disallow | /wp-content/* |
| Disallow | /integerating-plezi-gem-in-our-existing-rails-chat-application-2/ |
| Disallow | /running-django-application-on-vagrant/ |
| Disallow | /projects/ |
| Disallow | /case-studies*.php |
| Disallow | /BoTre_Backup_28-07-2016/ |
| Disallow | /BoTree-Old-Site-25-01-2016/ |
| Disallow | /BoTree_Website_Backup_June_2017/ |
| Disallow | /case-studies_/ |
| Disallow | /demo/ |
| Disallow | /demotheme/ |
| Disallow | /dev/ |
| Disallow | /ecommerce-css/ |
| Disallow | /ecommerce-img/ |
| Disallow | /ecommerce-js/ |
| Disallow | /ecommerce-page/ |
| Disallow | /ecommerce-services/ |
| Disallow | /javaenterprisesolutions/ |
| Disallow | /includes/ |
| Disallow | /landingPage/ |
| Disallow | /magento2/ |
| Disallow | /new/ |
| Disallow | /offerings/ |
| Disallow | /redesign_2017/ |
| Disallow | /stackpathtech/ |
| Disallow | /botree_2020/ |
| Disallow | /old-backup/ |
| Disallow | /popup-dev/ |
| Disallow | /10-11/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.botreetechnologies.com/sitemap.xml |