racenet.com.au
robots.txt
Robots Exclusion Standard data for racenet.com.au
Resource Scan
Scan Details
Site Domain | racenet.com.au |
Base Domain | racenet.com.au |
Scan Status | Ok |
Last Scan | 2024-06-15T02:39:24+00:00 |
Next Scan | 2024-06-22T02:39:24+00:00 |
Last Scan
Scanned | 2024-06-15T02:39:24+00:00 |
URL | https://racenet.com.au/robots.txt |
Redirect | https://www.racenet.com.au:443/robots.txt |
Redirect Domain | www.racenet.com.au |
Redirect Base | racenet.com.au |
Domain IPs | 13.35.18.10, 13.35.18.123, 13.35.18.25, 13.35.18.6 |
Redirect IPs | 13.35.18.10, 13.35.18.123, 13.35.18.25, 13.35.18.6 |
Response IP | 13.35.18.25 |
Found | Yes |
Hash | b620aa6217a83e1ec5a0671f1098caa38ee659314ca6a11618a27a6cba24b51d |
SimHash | f93dc772e1b0 |
Groups
*
Rule | Path |
---|---|
Disallow | /dev/ |
Disallow | /rnadmin/ |
Disallow | /301/ |
Disallow | /aap-form/ |
Disallow | /AapFormProcess/ |
Disallow | /aapresults/ |
Disallow | /AdInc/ |
Disallow | /admin/ |
Disallow | /risaForm/ |
Disallow | /iframe/ |
Disallow | /*?* |
Disallow | /*.pdf$ |
Disallow | /bet/* |
Disallow | /*subscribe/ |
Disallow | /*remote/ |
Disallow | /*results/greyhounds/*/* |
Disallow | /*results/harness/*/* |
Disallow | /*profiles/horse/sunset/* |
Disallow | /*profiles/jockey/sunset/* |
Disallow | /*profiles/trainer/sunset/* |
Allow | /*results/greyhounds/*/all-races$ |
Allow | /*results/harness/*/all-races$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.racenet.com.au/sitemap.xml |