betturtle.com
robots.txt
Robots Exclusion Standard data for betturtle.com
Resource Scan
Scan Details
Site Domain | betturtle.com |
Base Domain | betturtle.com |
Scan Status | Ok |
Last Scan | 2024-06-05T21:26:53+00:00 |
Next Scan | 2024-07-05T21:26:53+00:00 |
Last Scan
Scanned | 2024-06-05T21:26:53+00:00 |
URL | https://www.betturtle.com/robots.txt |
Domain IPs | 108.128.72.146, 54.216.252.255, 54.73.26.109 |
Response IP | 54.216.252.255 |
Found | Yes |
Hash | 06dd543cb28f53b3606874e57f9a28816fbb8ffb3e379a5a09ae81d1ff3d096b |
SimHash | c400ea417d10 |
Groups
*
Rule | Path |
---|---|
Disallow | /u/ |
Disallow | /u |
Disallow | /admin |
Disallow | /blog/2016/04/13/betturtle-newsletter-wednesday-13th-april-2016/www.betturtle.com |
Disallow | /betturtle/futureraces/ |
Disallow | /weblog/tags/mcturtle/ |
Disallow | /betturtle/thankyou |
Disallow | /betturtle/paypal/ |
Disallow | /betturtle/thankyou |
Disallow | /select/system |
Disallow | /weblog/feeds |
Disallow | /weblog/feeds/* |
Disallow | /weblog/feeds/ |
Disallow | /select/ |
Disallow | /select/system* |
Disallow | /api/* |
Disallow | /weblog/* |
Disallow | /filters/ |
Disallow | /accounts/signup/ |
Disallow | /downloads/ |
Disallow | /betturtle/api/* |
Disallow | /betturtle/api/ |
Disallow | /betturtle/*/racecard/ |
Disallow | /betturtle/*/racecard |
Warnings
- `host` is not a known field.