uline.com
robots.txt

Robots Exclusion Standard data for uline.com

Resource Scan

Scan Details

Site Domain uline.com
Base Domain uline.com
Scan Status Ok
Last Scan2024-05-21T12:10:28+00:00
Next Scan 2024-06-04T12:10:28+00:00

Last Scan

Scanned2024-05-21T12:10:28+00:00
URL https://uline.com/robots.txt
Redirect https://www.uline.com/robots.txt
Redirect Domain www.uline.com
Redirect Base uline.com
Domain IPs 23.215.7.18, 23.215.7.26
Redirect IPs 23.32.29.9, 96.17.180.42
Response IP 23.53.33.177
Found Yes
Hash 68d14fcafef527b2f60cba99d57e1d6e252c56a2b058b3723d6a94b2358c3a89
SimHash 08315f238a94

Groups

*

Rule Path
Disallow /Signin/signin
Disallow /Signin/Registration2of3
Disallow /Signin/UserExists
Disallow /Product/SearchNotFound
Disallow /Error_404
Disallow /Error_500
Disallow /ErrorPage
Disallow /ErrorPage.htm
Disallow /Product/Detail/S-423-6
Disallow /Product/ProductEmail
Disallow /Product/Catalog_View
Disallow /Corporate/EstimateDelivery
Disallow /MyAccount/VerifyInfo
Disallow /MyAccount/MyContactsReview
Disallow /MyAccount/EmailMarketingPreferencesLanding
Disallow /MyAccount/Invoices
Disallow /MyAccount/InvoiceDetail
Disallow /MyAccount/PayInvoices
Disallow /Ordering/Step1AddAddress
Disallow /Ordering/Step1Address
Disallow /Ordering/Step2Carrier
Disallow /Ordering/Step2Pickup
Disallow /Ordering/Step3Payment
Disallow /Ordering/Step4Confirm
Disallow /Ordering/Step5OrderSubmitted
Disallow /Product/ProductDetail/CustomerSpecialPricing
Disallow /VPNError
Disallow /HealthCheckService/
Disallow /HealthCheck/

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

gptbot
chatgpt-user
ccbot

Rule Path
Disallow /Product/AdvSearchResult
Disallow /Cls_*
Disallow /Grp_*
Disallow /BL_*
Disallow /Product/Detail/*

Other Records

Field Value
sitemap http://www.uline.com/sitemapindex.xml