thomasnet.com
robots.txt
Robots Exclusion Standard data for thomasnet.com
Resource Scan
Scan Details
| Site Domain | thomasnet.com |
| Base Domain | thomasnet.com |
| Scan Status | Ok |
| Last Scan | 2024-10-31T21:03:48+00:00 |
| Next Scan | 2024-11-07T21:03:48+00:00 |
Last Scan
| Scanned | 2024-10-31T21:03:48+00:00 |
| URL | https://thomasnet.com/robots.txt |
| Redirect | https://www.thomasnet.com/robots.txt |
| Redirect Domain | www.thomasnet.com |
| Redirect Base | thomasnet.com |
| Domain IPs | 100.27.94.170, 2600:1f18:6743:fd05:65b8:cf5:affa:8cb2, 2600:1f18:6743:fd07:3c7f:390a:cec3:539e, 34.233.65.205 |
| Redirect IPs | 104.18.36.207, 172.64.151.49, 2606:4700:4400::6812:24cf, 2606:4700:4400::ac40:9731 |
| Response IP | 104.18.36.207 |
| Found | Yes |
| Hash | 32fcbb122fc3616762d3f1e9c5db674738a0f06736bca09275574e1c63f16cf1 |
| SimHash | c180d7955e88 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404.html |
| Disallow | /ProductInformationHQ.html |
| Disallow | /RCS/ |
| Disallow | /Seminar/ |
| Disallow | /adlink.html |
| Disallow | /advsearch.html |
| Disallow | /branchheading.html |
| Disallow | /branchprofile.html |
| Disallow | /brands.html |
| Disallow | /browsecatalogcats.html |
| Disallow | /browse.html |
| Disallow | /businessweek.html |
| Disallow | /cadcb.html |
| Disallow | /cadlibrary.html |
| Disallow | /cadlink.html |
| Disallow | /cadpl.html |
| Disallow | /cadps.html |
| Disallow | /cad-taxonomy.xml.gz |
| Disallow | /capabilities-services.html |
| Disallow | /captcha/ |
| Disallow | /catalognavigator.html |
| Disallow | /catalogs/keyword/ |
| Disallow | /catnav/browse.html |
| Disallow | /catnav/itemdetail.html |
| Disallow | /catnav/list.html |
| Disallow | /catnav/productdetail.html |
| Disallow | /catnav/products.html |
| Disallow | /ccpcontent.html |
| Disallow | /cduser/ |
| Disallow | /cofeedback.html |
| Disallow | /cofeedback_send.html |
| Disallow | /commodityresults.html |
| Disallow | /company-certifications.html |
| Disallow | /company-information.html |
| Disallow | /compare.html |
| Disallow | /compsearch.html |
| Disallow | /conews.html |
| Disallow | /contactcompany.html |
| Disallow | /contactcompany_send.html |
| Disallow | /dc/ |
| Disallow | /dnb/ |
| Disallow | /ecatalog/ |
| Disallow | /emailcatalog.html |
| Disallow | /emailcolleague.html |
| Disallow | /emailprofile.html |
| Disallow | /emailresults.html |
| Disallow | /feedback.html |
| Disallow | /feedback_send.html |
| Disallow | /free/ |
| Disallow | /gen/ |
| Disallow | /generalinfo.html |
| Disallow | /gotowin/ |
| Disallow | /heading.html |
| Disallow | /headinginfo.html |
| Disallow | /headingtrdir.html |
| Disallow | /inc/ |
| Disallow | /industrialmarkettrends |
| Disallow | /local.html |
| Disallow | /map-company.html |
| Disallow | /map-print.html |
| Disallow | /multicontact.html |
| Disallow | /multiselect.html |
| Disallow | /mythomas/ |
| Disallow | /newlook.html |
| Disallow | *nsearch.html? |
| Disallow | /pcb-attribute-details.html |
| Disallow | /pnnalerts.html |
| Disallow | /pnnalerts_save.html |
| Disallow | /preview.html |
| Disallow | /print/ |
| Disallow | /product-information.html |
| Disallow | /productsearch/productspecs.html |
| Disallow | /profile.html |
| Disallow | /profileinfo.html |
| Disallow | /profilenews.html |
| Disallow | /register/ |
| Disallow | /results.html |
| Disallow | /rfi/ |
| Disallow | /scripts/ |
| Disallow | /search/additional_suppliers.php |
| Disallow | /seealso.html |
| Disallow | /seminar/ |
| Disallow | /seminars/ |
| Disallow | /spreadword.html |
| Disallow | /spreadword_send.html |
| Disallow | /subscriber/ |
| Disallow | /survey/ |
| Disallow | /terms.html |
| Disallow | /tgr.html |
| Disallow | /tnetfooter.html |
| Disallow | /tnetheader.html |
| Disallow | /toolbarv2/ |
| Disallow | /tools-gadgets/ |
| Disallow | /trdir.html |
| Disallow | /user/ |
| Disallow | /vimeo.html |
| Disallow | /vlink.html |
| Disallow | /webcontactcompany.html |
| Disallow | /webprofile.html |
| Disallow | /webprofileinfo.html |
| Disallow | /webresults.html |
| Disallow | /websearchlink.html |
| Disallow | /white-papers/publisher/ |
| Disallow | /order.html |
| Disallow | /configure.html |
| Disallow | /product-service-detail.html |
| Disallow | /whitepaper-details.html |
| Disallow | /whitepapers.html |
| Disallow | /catalog-images.html |
| Disallow | /bsearch.html |
| Disallow | /branches.html |
| Disallow | /local/ |
| Disallow | /*?*heading= |
| Disallow | /*%26heading%3D |
| Disallow | /*%26cert%3D |
| Disallow | /*?*cert= |
| Disallow | /*%26supplier_validation%3D |
| Disallow | /*?*supplier_validation= |
| Disallow | /*%26act%3D |
| Disallow | /*?*act= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thomasnet.com/sitemap_index.xml.gz |
| sitemap | https://www.thomasnet.com/suppliers/sitemap/index.xml |
Warnings
- 2 invalid lines.