golfpass.com
robots.txt

Robots Exclusion Standard data for golfpass.com

Resource Scan

Scan Details

Site Domain golfpass.com
Base Domain golfpass.com
Scan Status Ok
Last Scan2024-09-22T06:30:59+00:00
Next Scan 2024-10-06T06:30:59+00:00

Last Scan

Scanned2024-09-22T06:30:59+00:00
URL https://golfpass.com/robots.txt
Redirect https://www.golfpass.com/robots.txt
Redirect Domain www.golfpass.com
Redirect Base golfpass.com
Domain IPs 34.105.101.21
Redirect IPs 13.33.183.122, 13.33.183.19, 13.33.183.57, 13.33.183.7, 2600:9000:271a:3c00:7:96ce:e5c0:93a1, 2600:9000:271a:7e00:7:96ce:e5c0:93a1, 2600:9000:271a:8400:7:96ce:e5c0:93a1, 2600:9000:271a:9000:7:96ce:e5c0:93a1, 2600:9000:271a:a800:7:96ce:e5c0:93a1, 2600:9000:271a:aa00:7:96ce:e5c0:93a1, 2600:9000:271a:b000:7:96ce:e5c0:93a1, 2600:9000:271a:ee00:7:96ce:e5c0:93a1
Response IP 3.165.82.125
Found Yes
Hash f6ae965eb863364cfc0d422a219130b025a256f931b9fc9b26969b8e84f81a63
SimHash 42185850a4a2

Groups

*

Rule Path
Disallow /api/
Disallow /search/
Disallow /courses/bvr/
Disallow /courses/badges/
Disallow /courses/feed/
Disallow /golfers/
Disallow /xgo/
Disallow /course-directory/
Disallow /travel-advisor/api/
Disallow /travel-advisor/search/
Disallow /travel-advisor/courses/bvr/
Disallow /travel-advisor/courses/badges/
Disallow /travel-advisor/courses/feed/
Disallow /travel-advisor/golfers/
Disallow /travel-advisor/xgo/
Disallow /travel-advisor/authenticate/register

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.golfpass.com/travel-advisor/sitemap.xml
sitemap https://www.golfpass.com/travel-advisor/video-sitemap.xml
sitemap https://www.golfpass.com/travel-advisor/news-sitemap.xml
sitemap https://www.golfpass.com/sitemap.xml