punters.com.au
robots.txt

Robots Exclusion Standard data for punters.com.au

Resource Scan

Scan Details

Site Domain punters.com.au
Base Domain punters.com.au
Scan Status Ok
Last Scan2024-06-14T14:49:47+00:00
Next Scan 2024-06-21T14:49:47+00:00

Last Scan

Scanned2024-06-14T14:49:47+00:00
URL https://punters.com.au/robots.txt
Redirect https://www.punters.com.au/robots.txt
Redirect Domain www.punters.com.au
Redirect Base punters.com.au
Domain IPs 18.155.68.111, 18.155.68.58, 18.155.68.66, 18.155.68.98
Redirect IPs 13.225.4.3, 13.225.4.34, 13.225.4.59, 13.225.4.83
Response IP 13.225.4.83
Found Yes
Hash 24793efd1698cf5be27b18a036a27465e4e0cc731e7e29134c327986b656a682
SimHash d920ef30ac73

Groups

googlebot-news

Rule Path
Allow /news/
Allow /amp/news/
Disallow /

*

Rule Path
Allow /api/web/widget/
Allow /*racing-results/greyhounds/*/all-races/$
Allow /*racing-results/harness/*/all-races/$
Disallow /search/
Disallow /login/
Disallow /api/
Disallow /*betting/?market*
Disallow /*isSubscriber%3D*
Disallow /*live/news-perform/*
Disallow /*forum/*/sorted*
Disallow /*forum/*/?page=*
Disallow /*feed/?startAfter=*
Disallow /*?ReturnUrl=*
Disallow /news/*/*?view=tab
Disallow /odds-comparison/*/*/*/?raceNumber=*
Disallow /odds-comparison/*/*/*/?selection=*
Disallow /odds-comparison/*/*/*/?bookmakers=*
Disallow /odds-comparison/*/*/*/?format=*
Disallow /link/*/
Disallow /*subscribe/
Disallow /*news/*/*/
Disallow /*remote/
Disallow /*?a=
Disallow /*?sid=
Disallow /*?source=
Disallow /*?dynamic=true
Disallow /*video-replays/hkjc/?*
Disallow /*racing-results/greyhounds/*/*/
Disallow /*racing-results/harness/*/*/
Disallow /*horses/sunset/*
Disallow /*jockeys/sunset/*
Disallow /*trainers/sunset/*

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.punters.com.au/sitemap.xml