molex.com
robots.txt
Robots Exclusion Standard data for molex.com
Resource Scan
Scan Details
| Site Domain | molex.com |
| Base Domain | molex.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-15T06:31:59+00:00 |
| Next Scan | 2024-12-14T06:31:59+00:00 |
Last Successful Scan
| Scanned | 2022-10-30T18:17:15+00:00 |
| URL | https://www.molex.com/robots.txt |
| Response IP | 23.9.185.222 |
| Found | Yes |
| Hash | aa05f032d2a330e26c2f8c1e672e3a4fe889aa0a44001aa4a04b8ea7d3eda7c5 |
| SimHash | 6d52d894c362 |
Groups
demandbasesiteanalyzer/0.1 (http://www.demandbase.com; info@demandbase.com)
| Rule | Path |
|---|---|
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /molex/pressRoom/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
slurp
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
naverbot
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /molex/search/ |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
panasonic-crawling
| Rule | Path |
|---|---|
| Allow | /molex/products/ |
| Disallow | /molex/register/ |
| Disallow | /link/ |
| Disallow | /suppliers/ |
| Disallow | /customer.html |
| Disallow | /cmc_upload/ |
| Disallow | /molex/products/distributors/ |
| Disallow | /pdm_docs/ |
| Disallow | /images/MSTD/ |
| Disallow | /training/ |
| Disallow | /molex/electrical_model/ |
| Disallow | /donotvisit/ |
| Disallow | /molex/search/ |
| Disallow | *jsessionid* |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments