Log In Sign Up

chemdirect.com
robots.txt

Robots Exclusion Standard data for chemdirect.com

Resource Scan

Scan Details

Site Domain chemdirect.com
Base Domain chemdirect.com
Scan Status Ok
Last Scan2024-09-16T20:15:00+00:00
Next Scan 2024-10-16T20:15:00+00:00

Last Scan

Scanned2024-09-16T20:15:00+00:00
URL https://chemdirect.com/robots.txt
Redirect https://www.chemdirect.com/robots.txt
Redirect Domain www.chemdirect.com
Redirect Base chemdirect.com
Domain IPs 172.202.155.73
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash cec20b8600a941029245a2edd12c9197f13f9912a889b15d05126829e1ab6f92
SimHash 70029111cdff

Groups

*

Rule Path
Disallow

google-inspectiontool

Rule Path
Allow /
Disallow /product-list/c/all?q=*

googlebot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

yahoo! slurp

Rule Path
Allow /
Disallow /product-list/c/all?q=*

bingbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

yandex

Rule Path
Allow /
Disallow /product-list/c/all?q=*

baiduspider

Rule Path
Allow /
Disallow /product-list/c/all?q=*

facebookexternalhit

Rule Path
Allow /
Disallow /product-list/c/all?q=*

twitterbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

rogerbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

linkedinbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

embedly

Rule Path
Allow /
Disallow /product-list/c/all?q=*

quora link preview

Rule Path
Allow /
Disallow /product-list/c/all?q=*

showyoubot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

developers.google.com/+/web/snippetoutbrain

Rule Path
Allow /
Disallow /product-list/c/all?q=*

slackbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

vkshare

Rule Path
Allow /
Disallow /product-list/c/all?q=*

w3c_validator

Rule Path
Allow /
Disallow /product-list/c/all?q=*

redditbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

applebot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

whatsapp

Rule Path
Allow /
Disallow /product-list/c/all?q=*

flipboard

Rule Path
Allow /
Disallow /product-list/c/all?q=*

bitlybot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

skypeuripreview

Rule Path
Allow /
Disallow /product-list/c/all?q=*

nuzzel

Rule Path
Allow /
Disallow /product-list/c/all?q=*

discordbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

google page speed

Rule Path
Allow /
Disallow /product-list/c/all?q=*

qwantify

Rule Path
Allow /
Disallow /product-list/c/all?q=*

pinterestbot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

bitrix link preview

Rule Path
Allow /
Disallow /product-list/c/all?q=*

xing-contenttabreceiver

Rule Path
Allow /
Disallow /product-list/c/all?q=*

chrome-lighthouse

Rule Path
Allow /
Disallow /product-list/c/all?q=*

telegrambot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

seznambot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

semrushbot-sa

Rule Path
Allow /
Disallow /product-list/c/all?q=*

semrushbot-si

Rule Path
Allow /
Disallow /product-list/c/all?q=*

ahrefssiteaudit

Rule Path
Allow /
Disallow /product-list/c/all?q=*

googlebot

Rule Path
Allow /
Disallow /product-list/c/all?q=*

googlebot-image

Rule Path
Allow /
Disallow /product-list/c/all?q=*

screaming frog seo spider

Rule Path
Allow /
Disallow /product-list/c/all?q=*
Back to top

Other Records

Field Value
sitemap https://www.chemdirect.com/sitemap-index.xml
Back to top