industrybuying.com
robots.txt
Robots Exclusion Standard data for industrybuying.com
Resource Scan
Scan Details
| Site Domain | industrybuying.com |
| Base Domain | industrybuying.com |
| Scan Status | Ok |
| Last Scan | 2024-10-01T06:26:03+00:00 |
| Next Scan | 2024-10-15T06:26:03+00:00 |
Last Scan
| Scanned | 2024-10-01T06:26:03+00:00 |
| URL | https://industrybuying.com/robots.txt |
| Redirect | https://www.industrybuying.com/robots.txt |
| Redirect Domain | www.industrybuying.com |
| Redirect Base | industrybuying.com |
| Domain IPs | 104.22.0.155, 104.22.1.155, 172.67.26.107, 2606:4700:10::6816:19b, 2606:4700:10::6816:9b, 2606:4700:10::ac43:1a6b |
| Redirect IPs | 15.207.122.209, 3.6.13.78, 3.7.240.9 |
| Response IP | 3.6.13.78 |
| Found | Yes |
| Hash | 211881328644426477a0b023e9a973a15ac5ea67ff4e80cb2e7cf2e2658e414d |
| SimHash | ea923c018ec2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /categories* |
| Disallow | /special-categories-/* |
| Disallow | /*.pdf/* |
| Disallow | /search/* |
| Disallow | /?f_brand_* |
| Disallow | /?sort=* |
| Disallow | /?discount_category=* |
| Disallow | /?promo=* |
| Disallow | /?f_* |
| Disallow | /?page* |
| Disallow | /?*&sort=* |
| Disallow | /?q=* |
| Disallow | /?* |
| Disallow | /product_details/* |
| Disallow | /?Watt=* |
| Disallow | /order/cart* |
| Disallow | /quotation/my-quotation/ |
| Disallow | /user/* |
| Disallow | /mobile_similar_products* |
| Disallow | /mobile-bought-together/* |
| Disallow | /bought-together/* |
| Disallow | /similar_products/* |
| Disallow | /active-list/* |
| Disallow | /list-payment-mode-promotion/* |
| Disallow | /user-reviews/* |
| Disallow | /shipment/* |
| Disallow | /mobile-compatible-products/* |
| Disallow | /compatible-products/* |
| Disallow | /report-issue* |
| Disallow | /promo/* |
| Disallow | /order/* |
| Disallow | /web/* |
| Disallow | /order/payment* |
| Disallow | /user/login* |
| Disallow | /order/address* |
| Disallow | /user/account* |
| Disallow | auth/login* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.industrybuying.com/sitemap_index.xml |
| sitemap | https://www.industrybuying.com/static/sitemap_new_leaf_sku.xml |