gmpartsstore.com
robots.txt
Robots Exclusion Standard data for gmpartsstore.com
Resource Scan
Scan Details
| Site Domain | gmpartsstore.com |
| Base Domain | gmpartsstore.com |
| Scan Status | Ok |
| Last Scan | 2026-01-26T08:01:40+00:00 |
| Next Scan | 2026-02-02T08:01:40+00:00 |
Last Scan
| Scanned | 2026-01-26T08:01:40+00:00 |
| URL | https://gmpartsstore.com/robots.txt |
| Domain IPs | 104.20.30.126, 172.66.160.9, 2606:4700:10::6814:1e7e, 2606:4700:10::ac42:a009 |
| Response IP | 172.66.160.9 |
| Found | Yes |
| Hash | e299b095ce335ab12208e4df150c4d7b6795761845644bbddcf3ac19f6d4ed3d |
| SimHash | 6a95f363f714 |
Groups
perplexitybot
anthropic-ai
claude-web
claude-searchbot
claudebot
claude-user
chatgpt-user
oai-searchbot
gptbot
meta-externalagent
facebookbot
meta-externalfetcher
redditbot
whatsapp
yandexbot
yandeximages
amazonbot
applebot
ebaybot
pinterestbot
shopzilla
pricegrabber
yahoo-mmcrawler
slurp
mediapartners-yahoo
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /cart* |
| Disallow | /checkout* |
| Disallow | /account* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
msnbot
bingbot-image
bingbot-media
googlebot
googlebot-image
googlebot-video
googlebot-inspectiontool
google-extended
adsbot-google
adsbot-google-mobile
mediapartners-google
mediapartners-google-mobile
google-cloudvertexbot
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /cart* |
| Disallow | /checkout* |
| Disallow | /account* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0 |
ahrefsbot
blexbot
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /cart* |
| Disallow | /checkout* |
| Disallow | /account* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
semrushbot
semrushbot-ba
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /cart* |
| Disallow | /checkout* |
| Disallow | /account* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0 |
*
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /cart* |
| Disallow | /checkout* |
| Disallow | /account* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments