store.directsupply.com
robots.txt

Robots Exclusion Standard data for store.directsupply.com

Resource Scan

Scan Details

Site Domain store.directsupply.com
Base Domain directsupply.com
Scan Status Ok
Last Scan2025-12-29T21:11:41+00:00
Next Scan 2026-01-28T21:11:41+00:00

Last Scan

Scanned2025-12-29T21:11:41+00:00
URL https://store.directsupply.com/robots.txt
Domain IPs 13.33.45.125, 13.33.45.29, 13.33.45.38, 13.33.45.77
Response IP 13.33.45.125
Found Yes
Hash e81de13a23efed64000eaa09abf4b80fc533ba65edebfc325583ce7c87538ad2
SimHash 49190b75ce73

Groups

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

googlebot
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /QuickOrder
Disallow /Home/TermsOfUse
Disallow /Home/Copyright
Disallow /Cart
Disallow /Lists
Disallow /LogOn
Disallow /Search
Disallow /catalog*?*=

Other Records

Field Value
sitemap https://store.directsupply.com/sitemap.xml