Log In Sign Up

pgatour.com
robots.txt

Robots Exclusion Standard data for pgatour.com

Resource Scan

Scan Details

Site Domain pgatour.com
Base Domain pgatour.com
Scan Status Ok
Last Scan2024-05-11T06:30:29+00:00
Next Scan 2024-05-18T06:30:29+00:00

Last Scan

Scanned2024-05-11T06:30:29+00:00
URL https://pgatour.com/robots.txt
Redirect https://www.pgatour.com/robots.txt
Redirect Domain www.pgatour.com
Redirect Base pgatour.com
Domain IPs 2600:9000:2003:2e00:16:7ce5:3480:93a1, 2600:9000:2003:4c00:16:7ce5:3480:93a1, 2600:9000:2003:6400:16:7ce5:3480:93a1, 2600:9000:2003:8400:16:7ce5:3480:93a1, 2600:9000:2003:9000:16:7ce5:3480:93a1, 2600:9000:2003:b600:16:7ce5:3480:93a1, 2600:9000:2003:c400:16:7ce5:3480:93a1, 2600:9000:2003:da00:16:7ce5:3480:93a1, 52.84.229.18, 52.84.229.44, 52.84.229.72, 52.84.229.74
Redirect IPs 2600:9000:2003:4600:16:7ce5:3480:93a1, 2600:9000:2003:600:16:7ce5:3480:93a1, 2600:9000:2003:7e00:16:7ce5:3480:93a1, 2600:9000:2003:a200:16:7ce5:3480:93a1, 2600:9000:2003:c600:16:7ce5:3480:93a1, 2600:9000:2003:d200:16:7ce5:3480:93a1, 2600:9000:2003:e000:16:7ce5:3480:93a1, 2600:9000:2003:f400:16:7ce5:3480:93a1, 52.84.229.18, 52.84.229.44, 52.84.229.72, 52.84.229.74
Response IP 52.84.229.74
Found Yes
Hash 5116c9f966f8a3c044492563e98dfd2fb2ebd4971887db0183053f26feeab58c
SimHash fe5cd461ed05

Groups

*

Rule Path
Disallow *?v
Disallow *?cityName
Disallow /*/tournamentBannerRolex
Disallow /*/content.galleries.json/
Disallow /*rolex.frame
Disallow /rolex-clock/
Disallow /media-guide/
Disallow /*/enums
Disallow /*/utils
Disallow /*/Message
Disallow /bin/data/
Back to top

Other Records

Field Value
sitemap https://www.pgatour.com/sitemap.xml
sitemap https://www.pgatour.com/tour_sitemap.xml
sitemap https://www.pgatour.com/players_sitemap.xml
sitemap https://www.pgatour.com/stats_sitemap.xml
sitemap https://www.pgatour.com/tournament_sitemap.xml
sitemap https://www.pgatour.com/sitemap/articles.xml
sitemap https://www.pgatour.com/sitemap/videos.xml
Back to top

Comments

  • *
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top