golfdigest.com
robots.txt
Robots Exclusion Standard data for golfdigest.com
Resource Scan
Scan Details
Site Domain | golfdigest.com |
Base Domain | golfdigest.com |
Scan Status | Ok |
Last Scan | 2024-10-26T18:37:05+00:00 |
Next Scan | 2024-11-02T18:37:05+00:00 |
Last Scan
Scanned | 2024-10-26T18:37:05+00:00 |
URL | https://golfdigest.com/robots.txt |
Redirect | https://www.golfdigest.com/robots.txt |
Redirect Domain | www.golfdigest.com |
Redirect Base | golfdigest.com |
Domain IPs | 107.21.45.65, 3.211.193.33, 3.220.153.32, 34.227.139.94, 35.174.103.213, 52.23.88.10 |
Redirect IPs | 23.210.104.6, 2600:1413:1:591::1739, 2600:1413:1:59e::1739 |
Response IP | 23.210.104.6 |
Found | Yes |
Hash | c98623699b32990dde5db1913d0fcb8484f775b00a7210f5cbe6dd543fa68e72 |
SimHash | 5f10c942c011 |
Groups
*
Rule | Path |
---|---|
Allow | /content/dam/ |
Allow | /content/golfdigest-com/jcr%3Acontent/analytics.sitecatalyst.js |
Allow | /libs/granite/ |
Disallow | /libs/ |
Disallow | /services/ |
Disallow | /search/ |
Disallow | /features/apple-news/ |
Disallow | /shows/tv-schedule.* |
Disallow | *.embed |
Allow | *.lazy-fetch* |
Allow | *hotspot* |
Other Records
Field | Value |
---|---|
sitemap | https://www.golfdigest.com/sitemaps/sitemap_golfdigest_index.xml |