standards.globalspec.com
robots.txt
Robots Exclusion Standard data for standards.globalspec.com
Resource Scan
Scan Details
| Site Domain | standards.globalspec.com |
| Base Domain | globalspec.com |
| Scan Status | Ok |
| Last Scan | 2025-03-25T10:45:36+00:00 |
| Next Scan | 2025-04-24T10:45:36+00:00 |
Last Scan
| Scanned | 2025-03-25T10:45:36+00:00 |
| URL | https://standards.globalspec.com/robots.txt |
| Domain IPs | 104.18.4.83, 104.18.5.83 |
| Response IP | 104.18.5.83 |
| Found | Yes |
| Hash | c943013dfa1d01cf0f9b56da5143b17b53a81201d93392d68da39c9c8468b32b |
| SimHash | 7cd42f70ef43 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ajax/reference |
| Allow | /ajax/suppliers |
*
| Rule | Path |
|---|---|
| Disallow | /AdNetwork |
| Disallow | /advert/ |
| Disallow | /adnetwork |
| Disallow | /ajax |
| Disallow | /banner |
| Disallow | /cdn-cgi/* |
| Disallow | /Click |
| Disallow | /clientservices |
| Disallow | /ClientServices |
| Disallow | |
| Disallow | /Email/SupplierListEmail |
| Disallow | |
| Disallow | /engineering-search/patents |
| Disallow | /engineering-search/standards |
| Disallow | /featuredproducts/searchresults |
| Disallow | /FeaturedProducts/SearchResults |
| Disallow | /Frames |
| Disallow | /frames |
| Disallow | /goto |
| Disallow | /gotO |
| Disallow | /goTo |
| Disallow | /goTO |
| Disallow | /gOto |
| Disallow | /gOtO |
| Disallow | /gOTo |
| Disallow | /gOTO |
| Disallow | /Goto |
| Disallow | /GotO |
| Disallow | /GoTo |
| Disallow | /GoTO |
| Disallow | /GOto |
| Disallow | /GOtO |
| Disallow | /GOTo |
| Disallow | /GOTO |
| Disallow | /help/spechelp |
| Disallow | /help/spechelpfilter2 |
| Disallow | /help/supplierhelp |
| Disallow | /ListSiteSelfPublish |
| Disallow | /MediaKit/Contact |
| Disallow | /mediakit/contact |
| Disallow | /MediaKit/docs/ratecard.pdf |
| Disallow | /mls |
| Disallow | /MyGlobalSpec |
| Disallow | /MyGlobalspec |
| Disallow | /patents |
| Disallow | /ProductFinder/FindProducts |
| Disallow | /reference/search |
| Disallow | /Registration |
| Disallow | /registration |
| Disallow | /rfq |
| Disallow | /RFQ |
| Disallow | /Search |
| Disallow | /search |
| Disallow | /search/products |