golfshake.com
robots.txt

Robots Exclusion Standard data for golfshake.com

Resource Scan

Scan Details

Site Domain golfshake.com
Base Domain golfshake.com
Scan Status Ok
Last Scan2024-09-16T14:16:35+00:00
Next Scan 2024-09-23T14:16:35+00:00

Last Scan

Scanned2024-09-16T14:16:35+00:00
URL https://golfshake.com/robots.txt
Domain IPs 104.26.8.103, 104.26.9.103, 172.67.72.154, 2606:4700:20::681a:867, 2606:4700:20::681a:967, 2606:4700:20::ac43:489a
Response IP 104.26.8.103
Found Yes
Hash e1beaf9d88e471cc8f0d62b3d16bc2e903c99556dda450dd76f7e92ec1a5b6aa
SimHash 6a0cdc115ca0

Groups

*

Rule Path
Disallow /round/
Disallow /report/
Disallow /tools/
Disallow /home/
Disallow /group/
Disallow /golf/
Disallow /course/search/teetimes/
Disallow /course/teetimes/
Disallow /course/review/
Disallow /server/
Disallow /server/club/
Allow /

semrushbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /round/
Disallow /report/
Disallow /tools/
Disallow /home/
Disallow /group/
Disallow /golf/
Disallow /course/search/teetimes/
Disallow /course/teetimes/
Disallow /course/review/
Disallow /server/
Disallow /server/club/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /round/
Disallow /report/
Disallow /tools/
Disallow /home/
Disallow /group/
Disallow /golf/
Disallow /course/search/teetimes/
Disallow /course/teetimes/
Disallow /course/review/
Disallow /server/
Disallow /server/club/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.golfshake.com/sitemap.xml

Comments

  • Optional sitemap URL: