punters.com.au
robots.txt
Robots Exclusion Standard data for punters.com.au
Resource Scan
Scan Details
Site Domain | punters.com.au |
Base Domain | punters.com.au |
Scan Status | Ok |
Last Scan | 2024-06-14T14:49:47+00:00 |
Next Scan | 2024-06-21T14:49:47+00:00 |
Last Scan
Scanned | 2024-06-14T14:49:47+00:00 |
URL | https://punters.com.au/robots.txt |
Redirect | https://www.punters.com.au/robots.txt |
Redirect Domain | www.punters.com.au |
Redirect Base | punters.com.au |
Domain IPs | 18.155.68.111, 18.155.68.58, 18.155.68.66, 18.155.68.98 |
Redirect IPs | 13.225.4.3, 13.225.4.34, 13.225.4.59, 13.225.4.83 |
Response IP | 13.225.4.83 |
Found | Yes |
Hash | 24793efd1698cf5be27b18a036a27465e4e0cc731e7e29134c327986b656a682 |
SimHash | d920ef30ac73 |
Groups
*
Rule | Path |
---|---|
Allow | /api/web/widget/ |
Allow | /*racing-results/greyhounds/*/all-races/$ |
Allow | /*racing-results/harness/*/all-races/$ |
Disallow | /search/ |
Disallow | /login/ |
Disallow | /api/ |
Disallow | /*betting/?market* |
Disallow | /*isSubscriber%3D* |
Disallow | /*live/news-perform/* |
Disallow | /*forum/*/sorted* |
Disallow | /*forum/*/?page=* |
Disallow | /*feed/?startAfter=* |
Disallow | /*?ReturnUrl=* |
Disallow | /news/*/*?view=tab |
Disallow | /odds-comparison/*/*/*/?raceNumber=* |
Disallow | /odds-comparison/*/*/*/?selection=* |
Disallow | /odds-comparison/*/*/*/?bookmakers=* |
Disallow | /odds-comparison/*/*/*/?format=* |
Disallow | /link/*/ |
Disallow | /*subscribe/ |
Disallow | /*news/*/*/ |
Disallow | /*remote/ |
Disallow | /*?a= |
Disallow | /*?sid= |
Disallow | /*?source= |
Disallow | /*?dynamic=true |
Disallow | /*video-replays/hkjc/?* |
Disallow | /*racing-results/greyhounds/*/*/ |
Disallow | /*racing-results/harness/*/*/ |
Disallow | /*horses/sunset/* |
Disallow | /*jockeys/sunset/* |
Disallow | /*trainers/sunset/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.punters.com.au/sitemap.xml |