betterforinsight.com
robots.txt
Robots Exclusion Standard data for betterforinsight.com
Resource Scan
Scan Details
| Site Domain | betterforinsight.com |
| Base Domain | betterforinsight.com |
| Scan Status | Ok |
| Last Scan | 2025-10-15T04:20:51+00:00 |
| Next Scan | 2025-10-22T04:20:51+00:00 |
Last Scan
| Scanned | 2025-10-15T04:20:51+00:00 |
| URL | https://betterforinsight.com/robots.txt |
| Redirect | https://www.betterforinsight.com/robots.txt |
| Redirect Domain | www.betterforinsight.com |
| Redirect Base | betterforinsight.com |
| Domain IPs | 104.18.48.28, 104.18.53.27, 2606:4700:3114::6812:301c, 2606:4700:3119::6812:351b |
| Redirect IPs | 104.18.48.28, 104.18.53.27, 2606:4700:3114::6812:301c, 2606:4700:3119::6812:351b |
| Response IP | 104.18.48.28 |
| Found | Yes |
| Hash | 30eeb32f7c7821da9b8e1f5a5a42e4b6735b11cb45d28f92e0c7e6876b4612c7 |
| SimHash | 0874c850df10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*about.html$ |
| Disallow | /*contact.html$ |
| Disallow | /*guidance.html$ |
| Disallow | /*disclaimer.html$ |
| Disallow | /*dmca.html$ |
| Disallow | /*privacyPolicy.html$ |
| Disallow | /*rules.html$ |
| Disallow | /search |
| Disallow | /*/search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.betterforinsight.com/sitemap.xml |