thepartsdirect.com
robots.txt
Robots Exclusion Standard data for thepartsdirect.com
Resource Scan
Scan Details
| Site Domain | thepartsdirect.com |
| Base Domain | thepartsdirect.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T12:17:53+00:00 |
| Next Scan | 2024-07-07T12:17:53+00:00 |
Last Scan
| Scanned | 2024-06-07T12:17:53+00:00 |
| URL | https://thepartsdirect.com/robots.txt |
| Domain IPs | 13.225.4.104, 13.225.4.37, 13.225.4.80, 13.225.4.86 |
| Response IP | 13.225.4.80 |
| Found | Yes |
| Hash | bbf2a91298a49f026cc16e3a2dfc586ba38e2da70177000b5e0fd269304b43ca |
| SimHash | ae1f4c3eec9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /external/ |
| Disallow | /externalsearch/ |
| Disallow | /externalwebuser/ |
| Disallow | /internal/ |
| Disallow | /dashboard/ |
| Disallow | /account/ |
| Disallow | /activate/ |
| Disallow | /finish-register/ |
| Disallow | /user/ |
| Disallow | /settings |
| Disallow | /userzone |
| Disallow | /countries/ |
| Disallow | /manufacturers/search |
| Disallow | /manufacturer/search |
| Disallow | /parts/search |
| Disallow | /part/search |
| Disallow | /parts/multisearch |
| Disallow | /part/multisearch |
| Disallow | /search/ |
| Disallow | /autocomplete/ |
| Disallow | /part-list/edit |
| Disallow | /part-list/edit/ |
| Disallow | /part-list |
| Disallow | /rfq/ |
| Disallow | /support/ |
| Disallow | /sso/redirect |
| Disallow | /similar/ |
| Disallow | /*parts-starting-with* |
| Disallow | /products-and-services |
| Disallow | /products-and-services/ |
| Disallow | /product/*/distributors-and-vendors |
| Disallow | /service/*/vendors |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thepartsdirect.com/sitemap.xml.gz |