betturtle.com
robots.txt
Robots Exclusion Standard data for betturtle.com
Resource Scan
Scan Details
| Site Domain | betturtle.com |
| Base Domain | betturtle.com |
| Scan Status | Ok |
| Last Scan | 2024-06-05T21:26:53+00:00 |
| Next Scan | 2024-07-05T21:26:53+00:00 |
Last Scan
| Scanned | 2024-06-05T21:26:53+00:00 |
| URL | https://www.betturtle.com/robots.txt |
| Domain IPs | 108.128.72.146, 54.216.252.255, 54.73.26.109 |
| Response IP | 54.216.252.255 |
| Found | Yes |
| Hash | 06dd543cb28f53b3606874e57f9a28816fbb8ffb3e379a5a09ae81d1ff3d096b |
| SimHash | c400ea417d10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /u/ |
| Disallow | /u |
| Disallow | /admin |
| Disallow | /blog/2016/04/13/betturtle-newsletter-wednesday-13th-april-2016/www.betturtle.com |
| Disallow | /betturtle/futureraces/ |
| Disallow | /weblog/tags/mcturtle/ |
| Disallow | /betturtle/thankyou |
| Disallow | /betturtle/paypal/ |
| Disallow | /betturtle/thankyou |
| Disallow | /select/system |
| Disallow | /weblog/feeds |
| Disallow | /weblog/feeds/* |
| Disallow | /weblog/feeds/ |
| Disallow | /select/ |
| Disallow | /select/system* |
| Disallow | /api/* |
| Disallow | /weblog/* |
| Disallow | /filters/ |
| Disallow | /accounts/signup/ |
| Disallow | /downloads/ |
| Disallow | /betturtle/api/* |
| Disallow | /betturtle/api/ |
| Disallow | /betturtle/*/racecard/ |
| Disallow | /betturtle/*/racecard |
Warnings
- `host` is not a known field.