jb-systems.eu
robots.txt
Robots Exclusion Standard data for jb-systems.eu
Resource Scan
Scan Details
| Site Domain | jb-systems.eu |
| Base Domain | jb-systems.eu |
| Scan Status | Ok |
| Last Scan | 2025-09-22T05:42:15+00:00 |
| Next Scan | 2025-10-22T05:42:15+00:00 |
Last Scan
| Scanned | 2025-09-22T05:42:15+00:00 |
| URL | https://jb-systems.eu/robots.txt |
| Domain IPs | 104.21.40.241, 172.67.140.96, 2606:4700:3036::6815:28f1, 2606:4700:3037::ac43:8c60 |
| Response IP | 104.21.40.241 |
| Found | Yes |
| Hash | 8aae3d38e634fb6d72a5a849452304e52d411104ee114b741ee0a3ca58f40fef |
| SimHash | 0800aed10ab1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | /dealers/ | - |
| Disallow | /404/ | - |
| Disallow | /app/ | - |
| Disallow | /downloader/ | - |
| Disallow | /errors/ | - |
| Disallow | /includes/ | - |
| Disallow | /js/ | - |
| Disallow | /lib/ | - |
| Disallow | /magento/ | - |
| Disallow | /import/ | - |
| Disallow | */dealers/index/xml | - |
| Disallow | /media/captcha/ | - |
| Disallow | /media/customer/ | - |
| Disallow | /media/dhl/ | - |
| Disallow | /media/downloadable/ | - |
| Disallow | /media/import/ | - |
| Disallow | /media/js/ | - |
| Disallow | /media/pdf/ | - |
| Disallow | /media/sales/ | - |
| Disallow | /media/tmp/ | - |
| Disallow | /media/wysiwyg/ | - |
| Disallow | /media/xmlconnect/ | - |
| Disallow | /pkginfo/ | - |
| Disallow | /report/ | - |
| Disallow | /scripts/ | - |
| Disallow | /shell/ | - |
| Disallow | /skin/ | - |
| Disallow | /stats/ | - |
| Disallow | /var/ | - |
| Disallow | /index.php/ | - |
| Disallow | */catalog/product_compare/ | - |
| Disallow | */catalog/category/view/ | - |
| Disallow | */catalog/product/view/ | - |
| Disallow | */catalog/product/gallery/ | - |
| Disallow | */catalogsearch/ | - |
| Disallow | */checkout/ | - |
| Disallow | */control/ | - |
| Disallow | */contacts/ | - |
| Disallow | */customer/ | - |
| Disallow | */customize/ | - |
| Disallow | */newsletter/ | - |
| Disallow | */poll/ | - |
| Disallow | */review/ | - |
| Disallow | */sendfriend/ | - |
| Disallow | */tag/ | - |
| Disallow | */wiki/ | - |
| Disallow | */wishlist/ | - |
| Disallow | */fileuploader/download/* | - |
| Disallow | */pdfmanager/download/* | - |
| Disallow | */captcha/refresh/ | - |
| Disallow | /cron.php | - |
| Disallow | /cron.sh | - |
| Disallow | /error_log | - |
| Disallow | /install.php | - |
| Disallow | /LICENSE.html | - |
| Disallow | /LICENSE.txt | - |
| Disallow | /LICENSE_AFL.txt | - |
| Disallow | /STATUS.txt | - |
| Disallow | /get.php | Magento 1.5+ |
| Disallow | /*.php$ | - |
| Disallow | /*?SID= | - |
| Disallow | */rss* | - |
| Disallow | /*PHPSESSID | - |
| Disallow | /*?dir=* | - |
| Disallow | /*%26dir%3D* | - |
| Disallow | /*?mode=* | - |
| Disallow | /*%26mode%3D* | - |
| Disallow | /*?order=* | - |
| Disallow | /*%26order%3D* | - |
| Disallow | /*?p=* | - |
| Disallow | /*%26p%3D* | - |
| Disallow | /*%26limit%3D* | - |
| Disallow | /*?limit=* | - |
| Disallow | /*?beglec_attr_* | - |
| Disallow | /*%26beglec_attr_* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments