sourceesb.com
robots.txt
Robots Exclusion Standard data for sourceesb.com
Resource Scan
Scan Details
Site Domain | sourceesb.com |
Base Domain | sourceesb.com |
Scan Status | Ok |
Last Scan | 2024-09-11T05:02:57+00:00 |
Next Scan | 2024-10-11T05:02:57+00:00 |
Last Scan
Scanned | 2024-09-11T05:02:57+00:00 |
URL | https://sourceesb.com/robots.txt |
Redirect | https://thepartsdirect.com/robots.txt |
Redirect Domain | thepartsdirect.com |
Redirect Base | thepartsdirect.com |
Domain IPs | 13.225.4.104, 13.225.4.37, 13.225.4.80, 13.225.4.86 |
Redirect IPs | 13.225.4.104, 13.225.4.37, 13.225.4.80, 13.225.4.86 |
Response IP | 13.225.4.80 |
Found | Yes |
Hash | bbf2a91298a49f026cc16e3a2dfc586ba38e2da70177000b5e0fd269304b43ca |
SimHash | ae1f4c3eec9a |
Groups
*
Rule | Path |
---|---|
Disallow | /external/ |
Disallow | /externalsearch/ |
Disallow | /externalwebuser/ |
Disallow | /internal/ |
Disallow | /dashboard/ |
Disallow | /account/ |
Disallow | /activate/ |
Disallow | /finish-register/ |
Disallow | /user/ |
Disallow | /settings |
Disallow | /userzone |
Disallow | /countries/ |
Disallow | /manufacturers/search |
Disallow | /manufacturer/search |
Disallow | /parts/search |
Disallow | /part/search |
Disallow | /parts/multisearch |
Disallow | /part/multisearch |
Disallow | /search/ |
Disallow | /autocomplete/ |
Disallow | /part-list/edit |
Disallow | /part-list/edit/ |
Disallow | /part-list |
Disallow | /rfq/ |
Disallow | /support/ |
Disallow | /sso/redirect |
Disallow | /similar/ |
Disallow | /*parts-starting-with* |
Disallow | /products-and-services |
Disallow | /products-and-services/ |
Disallow | /product/*/distributors-and-vendors |
Disallow | /service/*/vendors |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
sitemap | https://thepartsdirect.com/sitemap.xml.gz |