progolfshirts.com
robots.txt

Robots Exclusion Standard data for progolfshirts.com

Resource Scan

Scan Details

Site Domain progolfshirts.com
Base Domain progolfshirts.com
Scan Status Ok
Last Scan2025-11-04T17:47:55+00:00
Next Scan 2025-12-04T17:47:55+00:00

Last Scan

Scanned2025-11-04T17:47:55+00:00
URL https://progolfshirts.com/robots.txt
Redirect https://www.progolfshirts.com/robots.txt
Redirect Domain www.progolfshirts.com
Redirect Base progolfshirts.com
Domain IPs 104.21.33.229, 172.67.193.155, 2606:4700:3030::ac43:c19b, 2606:4700:3034::6815:21e5
Redirect IPs 104.21.33.229, 172.67.193.155, 2606:4700:3030::ac43:c19b, 2606:4700:3034::6815:21e5
Response IP 104.21.33.229
Found Yes
Hash 206e4697a79720efe84abd2cba47f5f2a8f0b76ed129a8b8b787f05eb05d4683
SimHash 050453e65631

Groups

*

Rule Path
Allow /

ravencrawler

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

fastsearch

Rule Path
Allow /

alltheweb

Rule Path
Allow /

bingbot

Rule Path
Allow /

adidxbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

*

Rule Path
Disallow /wishlist*
Disallow /checkout/*
Disallow /search/results
Disallow /newsletter/subscribe
Disallow /cart/add-item
Disallow /product/*/options-matrix/*
Disallow /ajax/*
Disallow /lucee/*

Other Records

Field Value
sitemap https://www.progolfshirts.com/sitemap.xml

Comments

  • robots.txt for https://www.imageconnection.net/
  • do not change or delete this file, contact webmaster for edits.