dux-istra.com
robots.txt
Robots Exclusion Standard data for dux-istra.com
Resource Scan
Scan Details
| Site Domain | dux-istra.com |
| Base Domain | dux-istra.com |
| Scan Status | Ok |
| Last Scan | 2026-02-15T14:49:17+00:00 |
| Next Scan | 2026-03-17T14:49:17+00:00 |
Last Scan
| Scanned | 2026-02-15T14:49:17+00:00 |
| URL | https://dux-istra.com/robots.txt |
| Domain IPs | 104.21.24.184, 172.67.219.229, 2606:4700:3031::ac43:dbe5, 2606:4700:3032::6815:18b8 |
| Response IP | 172.67.219.229 |
| Found | Yes |
| Hash | 9258f0b87dd7b4f0bb2fb0b4997a184fcc4bd03bc0a518b22de155edbc0beb3d |
| SimHash | e938dbb30719 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /listings/results?* |
| Disallow | /listings/more?* |
| Disallow | /listings/contact?* |
| Disallow | /listings/tellafriend?* |
| Disallow | /listings/actions?* |
| Disallow | /listings/doc?* |
| Disallow | /listings/print?* |
| Disallow | /listings/pdf?* |
| Disallow | /listings/stats?* |
| Disallow | /listings/results_compare_module?* |
| Disallow | /listings_edit/* |
| Disallow | /listings_xml/* |
| Disallow | /products/results?* |
| Disallow | /products/more?* |
| Disallow | /products/contact?* |
| Disallow | /products/tellafriend?* |
| Disallow | /products/actions?* |
| Disallow | /listings/results_compare_module?* |
| Disallow | /products_xml/* |
| Disallow | /pages/tellafriend?* |
| Disallow | /pages?*id_page= |
| Disallow | /users/actions?* |
| Disallow | /contact/* |
| Disallow | /contacts_xml/* |
| Disallow | /login/* |
| Disallow | /likes/* |
| Disallow | /modules/* |
| Disallow | /orders/* |
| Disallow | /cart/* |
| Disallow | /newsletter/* |
| Disallow | /cache/* |
| Disallow | /site/* |
| Disallow | /sites/*/cache |
| Disallow | /sites/*/upload/du |
| Disallow | /sites/*/upload/listings_xml |
| Disallow | /sites/*/upload/products_xml |
| Disallow | /sites/*/upload/contacts_xml |
| Disallow | /sites/*/upload/userfiles/shared |
| Disallow | /sites/*/upload/listings/*.pdf$ |
| Disallow | /sites/*/upload/listings/*.doc$ |
| Disallow | /sites/*/upload/listings/*.docx$ |
| Disallow | /sites/*/upload/listings/*.xls$ |
| Disallow | /sites/*/upload/listings/*.xlsx$ |
| Disallow | /sites/*/upload/listings/*.txt$ |
| Disallow | /sites/*/upload/listings/*.mp3$ |
| Disallow | /sites/*/upload/listings/*.mp4$ |
| Disallow | /sites/*/upload/contacts |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dux-istra.com/sitemap.xml |