bobst.com
robots.txt
Robots Exclusion Standard data for bobst.com
Resource Scan
Scan Details
| Site Domain | bobst.com |
| Base Domain | bobst.com |
| Scan Status | Ok |
| Last Scan | 2025-05-17T12:13:14+00:00 |
| Next Scan | 2025-06-16T12:13:14+00:00 |
Last Scan
| Scanned | 2025-05-17T12:13:14+00:00 |
| URL | https://bobst.com/robots.txt |
| Redirect | https://www.bobst.com/robots.txt |
| Redirect Domain | www.bobst.com |
| Redirect Base | bobst.com |
| Domain IPs | 2001:1600:4:8:f816:3eff:feae:2592, 83.166.149.65 |
| Redirect IPs | 174.35.76.111 |
| Response IP | 174.35.76.111 |
| Found | Yes |
| Hash | 8f20a7612d09dadb5cc968807dfc0e4f6ace2e23195463d1ad45332f215d48de |
| SimHash | e920d28a46b3 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /fileadmin/templates/ | - |
| Disallow | /t3lib/ | - |
| Disallow | /typo3/ | - |
| Disallow | /typo3conf/ | - |
| Disallow | /*%26type%3D98 | Disable print pages |
| Disallow | /uploads/ | - |
| Disallow | /typo3_src/ | - |
| Disallow | /no_cache/ | - |
| Disallow | /tools/ | - |
| Disallow | /*newsletter-management* | - |
| Disallow | /*gestion-des-lettres-dinformation* | - |
| Disallow | /*%E6%97%B6%E4%BA%8B%E9%80%9A%E8%AE%AF%E7%AE%A1%E7%90%86* | - |
| Disallow | /*upravlenie-novostnoi-rassylkoi* | - |
| Disallow | /*boletin-de-noticias-gestion* | - |
| Disallow | /shop/index.php/ | - |
| Disallow | /checkout/ | - |
| Disallow | /tag/ | - |
| Disallow | /catalogsearch/ | - |
| Disallow | /review/ | - |
| Disallow | /app/ | - |
| Disallow | /downloader/ | - |
| Disallow | /js/ | - |
| Disallow | /lib/ | - |
| Disallow | /media/ | - |
| Disallow | /pkginfo/ | - |
| Disallow | /report/ | - |
| Disallow | /skin/ | - |
| Disallow | /var/ | - |
| Disallow | /catalog/ | - |
| Disallow | /customer/ | - |
Comments