judaica.com
robots.txt
Robots Exclusion Standard data for judaica.com
Resource Scan
Scan Details
| Site Domain | judaica.com |
| Base Domain | judaica.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-30T18:25:36+00:00 |
| Next Scan | 2026-03-30T18:25:36+00:00 |
Last Successful Scan
| Scanned | 2023-02-20T22:19:13+00:00 |
| URL | https://judaica.com/robots.txt |
| Redirect | https://www.judaica.com/robots.txt |
| Redirect Domain | www.judaica.com |
| Redirect Base | judaica.com |
| Domain IPs | 104.26.4.213, 104.26.5.213, 172.67.70.210, 2606:4700:20::681a:4d5, 2606:4700:20::681a:5d5, 2606:4700:20::ac43:46d2 |
| Redirect IPs | 104.26.4.213, 104.26.5.213, 172.67.70.210, 2606:4700:20::681a:4d5, 2606:4700:20::681a:5d5, 2606:4700:20::ac43:46d2 |
| Response IP | 104.26.4.213 |
| Found | Yes |
| Hash | c88b426092f75e21ff81adc7c10e34caf91b68ac6e8cbe1e293c6104b882ac2e |
| SimHash | 2236f81ccaf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
ccbot
| Rule | Path |
|---|---|
| Disallow | /404/ |
| Disallow | /app/ |
| Disallow | /cgi-bin/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /magento/ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /scripts/ |
| Disallow | /shell/ |
| Disallow | /stats/ |
| Disallow | /var/ |
| Disallow | /amconf/ |
| Disallow | /index.php/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /control/ |
| Disallow | /contacts/ |
| Disallow | /customer/ |
| Disallow | /customize/ |
| Disallow | /newsletter/ |
| Disallow | /poll/ |
| Disallow | /review/ |
| Disallow | /sendfriend/ |
| Disallow | /tag/ |
| Disallow | /wishlist/ |
| Disallow | /catalog/product/gallery/ |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /STATUS.txt |
| Disallow | /*.php$ |
| Disallow | /*?SID= |
| Disallow | /*?*dir= |
| Disallow | /*?*order= |
| Disallow | /*?*price= |
| Disallow | /*?*limit= |
| Disallow | /*?*artists= |
| Disallow | /*?*judaica_color= |
| Disallow | /*?*judaica_producttype= |
| Disallow | /*?*judaica_holiday= |
| Disallow | /*?*judaica_child_product_type= |
| Disallow | /*?*judaica_gender= |
| Disallow | /*?*books_nusach= |
| Disallow | /*?*books_format= |
| Disallow | /*?*judaica_length= |
| Disallow | /*?*ketubah_text_options= |
| Disallow | /*?*language= |
| Disallow | /*?*books_author_multiselect= |
| Disallow | /*?*_escaped_fragment_= |
| Disallow | /*?*cat= |
| Disallow | /*?*gclid= |
| Disallow | /*?*qty= |
| Disallow | /*?*product= |
| Disallow | /*?*ss_shopping_tools%3A |
| Disallow | /*?*shape%3A |
| Disallow | /*?*q%3A |
| Disallow | /*?*multicolor_tones%3A |
| Disallow | /*?*made_in%3A |
| Disallow | /*?*judaica_theme%3A |
| Disallow | /*?*judaica_recipient%3A |
| Disallow | /*?*judaica_occasion%3A |
| Disallow | /*?*judaica_material%3A |
| Disallow | /*?*judaica_color_new%3A |
| Disallow | /*?*judaica_theme%3A |
| Disallow | /*?*judaica_occasion%3A |
| Disallow | /*?*judaica_color_new%3A |
| Disallow | /*?*judaica_style%3A |
| Disallow | /*?*judaica_holiday%3A |
| Disallow | /*?*multicolor_tones%3A |
| Disallow | /*?*final_price%3A |
| Disallow | /*?*judaica_gender%3A |
| Disallow | /*?*judaica_artistdesigner%3A |
| Disallow | /*?*additional_region%3A |
| Disallow | /*?*alcohol_content%3A |
| Disallow | /*?*additional_supervision%3A |
| Disallow | /*?*bottlescase%3A |
| Disallow | /*?*child_quantity%3A |
| Disallow | /*?*child_sku%3A |
| Disallow | /*?*color%3A |
| Disallow | /*?*dryness%3A |
| Disallow | /*?*main_region%3A |
| Disallow | /*?*main_varietal%3A |
| Disallow | /*?*mevushal%3A |
| Disallow | /*?*pairs_well_with%3A |
| Disallow | /*?*producer%3A |
| Disallow | /*?*varietals%3A |
| Disallow | /*?*vintage%3A |
| Disallow | /*?*wine_type%3A |
| Disallow | /*?*kosher_for_passover%3A |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.judaica.com/sitemaps/judaica/sitemap.xml |
Comments