cdiweb.com
robots.txt
Robots Exclusion Standard data for cdiweb.com
Resource Scan
Scan Details
| Site Domain | cdiweb.com |
| Base Domain | cdiweb.com |
| Scan Status | Ok |
| Last Scan | 2025-11-15T07:49:14+00:00 |
| Next Scan | 2025-12-15T07:49:14+00:00 |
Last Scan
| Scanned | 2025-11-15T07:49:14+00:00 |
| URL | https://cdiweb.com/robots.txt |
| Domain IPs | 209.236.108.80 |
| Response IP | 209.236.108.80 |
| Found | Yes |
| Hash | 87d16ac61820f1972b604a3f98f9927f761169d4405ea686ab1f5c20a63901cd |
| SimHash | 60448a70ccd3 |
Groups
linguee
mj12bot/v1.4.5
ccbot
ahrefsbot
waypart-bot/2.1
semrushbot
goodzer/2.0
mauibot
femtosearchbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /QuickCheckout.aspx* |
| Disallow | /Cart.aspx* |
| Disallow | /PortalOrderStatus.aspx* |
| Disallow | /PortalFeedback.aspx* |
| Disallow | /PortalOrderDetail.aspx* |
| Disallow | /UserEwaveUnsubscribe.aspx* |
| Disallow | /UserPasswordLoginCheck.aspx* |
| Disallow | /CheckoutThanks.aspx* |
| Disallow | /Technical_Inquiry.aspx* |
| Disallow | /Technical_inquiry.aspx* |
| Disallow | /FeaturedProducts.aspx* |
| Disallow | /PortalInfoNotFound.aspx* |
| Disallow | /WebResource.axd* |
| Disallow | /ssl/* |
| Disallow | /Cate/* |
| Disallow | /Content/* |
| Disallow | /CSS/* |
| Disallow | /Scripts/* |
| Disallow | /JavaScript/* |
| Disallow | /Fonts/* |
| Disallow | /Bundles/* |
| Disallow | /ScriptResource/* |
| Disallow | /WebResource/* |
| Disallow | /PortalImages/* |
| Disallow | /Search/* |
| Disallow | /search/* |
| Disallow | /*?*att_ |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.xml |