engineering360.com
robots.txt

Robots Exclusion Standard data for engineering360.com

Resource Scan

Scan Details

Site Domain engineering360.com
Base Domain engineering360.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-26T15:23:31+00:00
Next Scan 2025-06-24T15:23:31+00:00

Last Successful Scan

Scanned2024-05-08T13:08:56+00:00
URL https://www.engineering360.com/robots.txt
Redirect https://www.globalspec.com/robots.txt
Redirect Domain www.globalspec.com
Redirect Base globalspec.com
Domain IPs 3.134.44.229
Redirect IPs 104.18.4.83, 104.18.5.83
Response IP 104.18.5.83
Found Yes
Hash e6a846a4e644eee28cd45dcb6c2fff5c1ea8d2446bb3952347f5d71675b140f2
SimHash f0d00730a742

Groups

teleport pro/1.29

Rule Path
Disallow /

teleport pro/1.29.1590

Rule Path
Disallow /

teleport pro/1.28

Rule Path
Disallow /

offline explorer/1.1

Rule Path
Disallow /

offline explorer/1.2

Rule Path
Disallow /

offline explorer/1.3

Rule Path
Disallow /

offline explorer/1.4

Rule Path
Disallow /

offline explorer/1.5

Rule Path
Disallow /

offline explorer/1.6

Rule Path
Disallow /

offline explorer/1.7

Rule Path
Disallow /

offline explorer/1.8

Rule Path
Disallow /

offline explorer/1.9

Rule Path
Disallow /

webcollage/1.93

Rule Path
Disallow /

webcollage/1.96

Rule Path
Disallow /

webcollage_save/1.93

Rule Path
Disallow /

rogerbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

*

Rule Path
Allow /ajax/reference
Allow /ajax/suppliers

*

Rule Path
Disallow /goto
Disallow /GoTo
Disallow /Goto
Disallow /Click
Disallow /click
Disallow /Frames
Disallow /frames
Disallow /SpecSearch/MatchingProducts
Disallow /SpecSearch/ProductSpecs
Disallow /specsearch/productspecs
Disallow /SpecSearch/EmailSupplierList
Disallow /specsearch/emailsupplierlist
Disallow /SpecSearch/Products
Disallow /specsearch/products
Disallow /SpecSearch/PartSpecs
Disallow /specsearch/partspecs
Disallow /MyGlobalSpec
Disallow /MyGlobalspec
Disallow /Email
Disallow /email
Disallow /registration
Disallow /Registration
Disallow /ListSiteSelfPublish
Disallow /mediakit/contact
Disallow /MediaKit/Contact
Disallow /MediaKit/docs/ratecard.pdf
Disallow /Supplier/PhoneAndFaxAll
Disallow /Supplier/InfoAll
Disallow /mls
Disallow /Search/viewcache
Disallow /SpecSearch/CompareCatalogs
Disallow /SpecSearch/CompareServiceDetails
Disallow /ServiceRFQ/ServiceRfqForm
Disallow /Email/SupplierListEmail
Disallow /Search
Disallow /search
Disallow /adnetwork
Disallow /AdNetwork
Disallow /patents
Disallow /engineering-search/patents
Disallow /engineering-search/standards
Disallow /help/spechelp
Disallow /help/spechelpfilter2
Disallow /help/supplierhelp
Disallow /ProductFinder/FindProducts
Disallow /reference/search
Disallow /banner
Disallow /TechLib/Search
Disallow /techlib/search
Disallow /ajax
Disallow /FeaturedProducts/SearchResults
Disallow /featuredproducts/searchresults
Disallow /rfq
Disallow /RFQ
Disallow /clientservices
Disallow /clientServices
Disallow /ClientServices
Disallow /SpecSearch/SuppliersByName/AllSuppliers
Disallow /advert/
Disallow /standards/referenced/
Disallow /standards/references/
Disallow /Tokens
Disallow /tokens
Disallow /SpecSearch/Print
Disallow /cdn-cgi/*