golfpost.com
robots.txt
Robots Exclusion Standard data for golfpost.com
Resource Scan
Scan Details
| Site Domain | golfpost.com |
| Base Domain | golfpost.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-09T20:10:20+00:00 |
| Next Scan | 2024-07-08T20:10:20+00:00 |
Last Successful Scan
| Scanned | 2022-09-18T15:39:08+00:00 |
| URL | https://golfpost.com/robots.txt |
| Redirect | https://www.golfpost.com/robots.txt |
| Redirect Domain | www.golfpost.com |
| Redirect Base | golfpost.com |
| Response IP | 172.67.212.229 |
| Found | Yes |
| Hash | 608f4684b94a049e2d5be0e60fe43521c030435585d4caa59fcc9ebf1c3e9232 |
| SimHash | 7928046e5a8c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /golfguide/ |
| Disallow | /clubnews/ |
| Disallow | /deals/ |
| Disallow | /travel/ |
| Disallow | /training/ |
| Disallow | /community/ |
| Disallow | /team/ |
| Disallow | /awgc/ |
| Disallow | /login/ |
| Disallow | /register/ |
| Disallow | /community-award-2019/ |
| Disallow | /golf-calendar/ |
| Disallow | /newsletter/ |
| Disallow | /equipment-finder/ |
| Disallow | /onboarding/ |
| Disallow | /throwback/ |
| Disallow | /bio-2019-tickets/ |
| Disallow | /peo-2019-tickets/ |
| Disallow | /community-award/ |
| Disallow | /widgets/ |
| Disallow | /guide/ |
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /offline.html |