bulkreefsupply.com
robots.txt
Robots Exclusion Standard data for bulkreefsupply.com
Resource Scan
Scan Details
Site Domain | bulkreefsupply.com |
Base Domain | bulkreefsupply.com |
Scan Status | Ok |
Last Scan | 2024-10-30T13:37:48+00:00 |
Next Scan | 2024-11-29T13:37:48+00:00 |
Last Scan
Scanned | 2024-10-30T13:37:48+00:00 |
URL | https://bulkreefsupply.com/robots.txt |
Redirect | https://www.bulkreefsupply.com/robots.txt |
Redirect Domain | www.bulkreefsupply.com |
Redirect Base | bulkreefsupply.com |
Domain IPs | 108.157.254.31, 108.157.254.50, 108.157.254.86, 108.157.254.98 |
Redirect IPs | 13.35.210.108, 13.35.210.36, 13.35.210.49, 13.35.210.54 |
Response IP | 13.35.210.49 |
Found | Yes |
Hash | e1cb4a59ffbbf36728389fd62f8d79498a0b3064b34dda18c6aa1753582fae4c |
SimHash | e1792d7666e5 |
Groups
*
Rule | Path |
---|---|
Disallow | /brsajax/ |
Disallow | /page_cache/ |
Disallow | /rewards_catalog/ |
Disallow | /asimprovedaddressvalidation/ |
Disallow | /notify/ |
Disallow | /review/product/listajax/ |
Disallow | /review/product/list/ |
Disallow | /catalog/category/view/id/ |
Disallow | /catalog/product/view/id/ |
Disallow | /errors/ |
Disallow | /brs-websys |
Disallow | /brs/ |
Disallow | /tmp/ |
Disallow | /wishlist/ |
Disallow | /customer/ |
Disallow | /checkout/ |
Disallow | /productalert/ |
Disallow | /sales/ |
Disallow | /catalogsearch/ |
Disallow | /amsociallogin/ |
Disallow | /shopby |
Disallow | /rest/ |
Disallow | /search |
Disallow | /m/ |
Disallow | /ppc/ |
Disallow | /ppcnav/ |
Disallow | /black-friday-test-home-page |
Disallow | /black-friday-test-doorbusters |
Disallow | /black-friday-test-deals |
Disallow | /apl-staging-* |
Other Records
Field | Value |
---|---|
sitemap | https://www.bulkreefsupply.com/sitemap/google_sitemap.xml |
sitemap | https://www.bulkreefsupply.com/sitemap/blog_sitemap.xml |
Comments