bulkreefsupply.com
robots.txt

Robots Exclusion Standard data for bulkreefsupply.com

Resource Scan

Scan Details

Site Domain bulkreefsupply.com
Base Domain bulkreefsupply.com
Scan Status Ok
Last Scan2024-10-30T13:37:48+00:00
Next Scan 2024-11-29T13:37:48+00:00

Last Scan

Scanned2024-10-30T13:37:48+00:00
URL https://bulkreefsupply.com/robots.txt
Redirect https://www.bulkreefsupply.com/robots.txt
Redirect Domain www.bulkreefsupply.com
Redirect Base bulkreefsupply.com
Domain IPs 108.157.254.31, 108.157.254.50, 108.157.254.86, 108.157.254.98
Redirect IPs 13.35.210.108, 13.35.210.36, 13.35.210.49, 13.35.210.54
Response IP 13.35.210.49
Found Yes
Hash e1cb4a59ffbbf36728389fd62f8d79498a0b3064b34dda18c6aa1753582fae4c
SimHash e1792d7666e5

Groups

*

Rule Path
Disallow /brsajax/
Disallow /page_cache/
Disallow /rewards_catalog/
Disallow /asimprovedaddressvalidation/
Disallow /notify/
Disallow /review/product/listajax/
Disallow /review/product/list/
Disallow /catalog/category/view/id/
Disallow /catalog/product/view/id/
Disallow /errors/
Disallow /brs-websys
Disallow /brs/
Disallow /tmp/
Disallow /wishlist/
Disallow /customer/
Disallow /checkout/
Disallow /productalert/
Disallow /sales/
Disallow /catalogsearch/
Disallow /amsociallogin/
Disallow /shopby
Disallow /rest/
Disallow /search
Disallow /m/
Disallow /ppc/
Disallow /ppcnav/
Disallow /black-friday-test-home-page
Disallow /black-friday-test-doorbusters
Disallow /black-friday-test-deals
Disallow /apl-staging-*

googlebot-image

Rule Path
Allow /media/

Other Records

Field Value
sitemap https://www.bulkreefsupply.com/sitemap/google_sitemap.xml
sitemap https://www.bulkreefsupply.com/sitemap/blog_sitemap.xml

Comments

  • 2021-01-22 : added to give Googlebot access to our product images