bulkreefsupply.com
robots.txt
Robots Exclusion Standard data for bulkreefsupply.com
Resource Scan
Scan Details
Site Domain | bulkreefsupply.com |
Base Domain | bulkreefsupply.com |
Scan Status | Ok |
Last Scan | 2024-08-31T13:32:48+00:00 |
Next Scan | 2024-09-30T13:32:48+00:00 |
Last Scan
Scanned | 2024-08-31T13:32:48+00:00 |
URL | https://bulkreefsupply.com/robots.txt |
Redirect | https://www.bulkreefsupply.com/robots.txt |
Redirect Domain | www.bulkreefsupply.com |
Redirect Base | bulkreefsupply.com |
Domain IPs | 54.192.18.110, 54.192.18.53, 54.192.18.62, 54.192.18.98 |
Redirect IPs | 3.165.102.106, 3.165.102.70, 3.165.102.75, 3.165.102.90 |
Response IP | 3.165.102.90 |
Found | Yes |
Hash | e1cb4a59ffbbf36728389fd62f8d79498a0b3064b34dda18c6aa1753582fae4c |
SimHash | e1792d7666e5 |
Groups
*
Rule | Path |
---|---|
Disallow | /brsajax/ |
Disallow | /page_cache/ |
Disallow | /rewards_catalog/ |
Disallow | /asimprovedaddressvalidation/ |
Disallow | /notify/ |
Disallow | /review/product/listajax/ |
Disallow | /review/product/list/ |
Disallow | /catalog/category/view/id/ |
Disallow | /catalog/product/view/id/ |
Disallow | /errors/ |
Disallow | /brs-websys |
Disallow | /brs/ |
Disallow | /tmp/ |
Disallow | /wishlist/ |
Disallow | /customer/ |
Disallow | /checkout/ |
Disallow | /productalert/ |
Disallow | /sales/ |
Disallow | /catalogsearch/ |
Disallow | /amsociallogin/ |
Disallow | /shopby |
Disallow | /rest/ |
Disallow | /search |
Disallow | /m/ |
Disallow | /ppc/ |
Disallow | /ppcnav/ |
Disallow | /black-friday-test-home-page |
Disallow | /black-friday-test-doorbusters |
Disallow | /black-friday-test-deals |
Disallow | /apl-staging-* |
Other Records
Field | Value |
---|---|
sitemap | https://www.bulkreefsupply.com/sitemap/google_sitemap.xml |
sitemap | https://www.bulkreefsupply.com/sitemap/blog_sitemap.xml |
Comments