greggdistributors.ca
robots.txt

Robots Exclusion Standard data for greggdistributors.ca

Resource Scan

Scan Details

Site Domain greggdistributors.ca
Base Domain greggdistributors.ca
Scan Status Ok
Last Scan2025-03-10T17:22:28+00:00
Next Scan 2025-04-09T17:22:28+00:00

Last Scan

Scanned2025-03-10T17:22:28+00:00
URL https://greggdistributors.ca/robots.txt
Domain IPs 40.112.243.8
Response IP 40.112.243.8
Found Yes
Hash a8dca4c34e62506f8199045a32a1f1f965a35d6836711db4cbb1adbebddfd372
SimHash 6b54457ef608

Groups

*

Rule Path
Disallow /cart
Disallow /checkout
Disallow /specials-updated
Disallow /specials.php
Disallow /gdlp-banners-viewer
Disallow /preview-gug-blogs
Disallow /contact-us
Disallow /contact
Disallow /resources/ipart
Disallow /pages/onsale
Disallow /cross-reference*
Disallow /pages/webnotes
Disallow /webnotes
Disallow /storefrontapi
Disallow /xxx-gdlp--testform
Disallow /account*
Disallow /storefrontapi/*
Disallow /checkout
Disallow /preview*
Disallow /teststore*
Disallow /flyer-page-promo*
Disallow /promo__test
Disallow /test-ing
Disallow /?resp_group=Default%2CVariations%2CItemProperties
Disallow /featured-camping
Disallow /search*
Disallow /Cutting-Wheels*
Disallow /category/3FADF4BBACF2462EBE43D0726CA7D1DA-GLO*
Disallow /category/d9a75785e4ec4fd2b38303088deb3cbf*
Disallow /category/*
Disallow /Installation-Tools*
Disallow /Truck-Boxes*
Disallow /Heavy-Duty-Bearings*
Disallow /Heavy-Duty-Hub-Caps*
Disallow /Heavy-Duty-Hub-Seals*

dotbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://greggdistributors.ca/sitemap.xml