globalspec.com
robots.txt
Robots Exclusion Standard data for globalspec.com
Resource Scan
Scan Details
| Site Domain | globalspec.com |
| Base Domain | globalspec.com |
| Scan Status | Ok |
| Last Scan | 2024-10-04T10:42:01+00:00 |
| Next Scan | 2024-11-03T10:42:01+00:00 |
Last Scan
| Scanned | 2024-10-04T10:42:01+00:00 |
| URL | https://globalspec.com/robots.txt |
| Domain IPs | 104.18.4.83, 104.18.5.83 |
| Response IP | 104.18.5.83 |
| Found | Yes |
| Hash | d7a93c6a174a5420bae19993c52444064ea8c128bc511e8cba2b49d723fbda9b |
| SimHash | 7cd42f70ef43 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ajax/reference |
| Allow | /ajax/suppliers |
*
| Rule | Path |
|---|---|
| Disallow | /AdNetwork |
| Disallow | /advert/ |
| Disallow | /adnetwork |
| Disallow | /ajax |
| Disallow | /banner |
| Disallow | /cdn-cgi/* |
| Disallow | /Click |
| Disallow | /clientservices |
| Disallow | /ClientServices |
| Disallow | |
| Disallow | /Email/SupplierListEmail |
| Disallow | |
| Disallow | /engineering-search/patents |
| Disallow | /engineering-search/standards |
| Disallow | /featuredproducts/searchresults |
| Disallow | /FeaturedProducts/SearchResults |
| Disallow | /Frames |
| Disallow | /frames |
| Disallow | /goto |
| Disallow | /GoTo |
| Disallow | /help/spechelp |
| Disallow | /help/spechelpfilter2 |
| Disallow | /help/supplierhelp |
| Disallow | /ListSiteSelfPublish |
| Disallow | /MediaKit/Contact |
| Disallow | /mediakit/contact |
| Disallow | /MediaKit/docs/ratecard.pdf |
| Disallow | /mls |
| Disallow | /MyGlobalSpec |
| Disallow | /MyGlobalspec |
| Disallow | /patents |
| Disallow | /ProductFinder/FindProducts |
| Disallow | /reference/search |
| Disallow | /Registration |
| Disallow | /registration |
| Disallow | /rfq |
| Disallow | /RFQ |
| Disallow | /Search |
| Disallow | /search |
| Disallow | /search/products |