petitchef.com
robots.txt
Robots Exclusion Standard data for petitchef.com
Resource Scan
Scan Details
| Site Domain | petitchef.com |
| Base Domain | petitchef.com |
| Scan Status | Ok |
| Last Scan | 2024-06-22T03:20:13+00:00 |
| Next Scan | 2024-06-29T03:20:13+00:00 |
Last Scan
| Scanned | 2024-06-22T03:20:13+00:00 |
| URL | https://petitchef.com/robots.txt |
| Redirect | https://pt.petitchef.com/robots.txt |
| Redirect Domain | pt.petitchef.com |
| Redirect Base | petitchef.com |
| Domain IPs | 104.26.6.56, 104.26.7.56, 172.67.75.140, 2606:4700:20::681a:638, 2606:4700:20::681a:738, 2606:4700:20::ac43:4b8c |
| Redirect IPs | 104.26.6.56, 104.26.7.56, 172.67.75.140, 2606:4700:20::681a:638, 2606:4700:20::681a:738, 2606:4700:20::ac43:4b8c |
| Response IP | 172.67.75.140 |
| Found | Yes |
| Hash | 2150e064c484e924678a83cefebbbeaeecf1c4ae1036e8666743bae393e400eb |
| SimHash | 053cc455c753 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php?obj=feed&action=print&* |
| Disallow | /shopping/ |
| Disallow | /index.php?obj=* |
| Disallow | /?obj=* |
| Disallow | /*?print* |
| Disallow | /*?related* |
| Disallow | /*%26in%3D* |
| Disallow | /*?nl_key* |
| Disallow | /*?autologin* |
| Disallow | /captcha/ |
| Disallow | /assets/wpn/ |
| Disallow | /directory |
| Disallow | /director |
| Disallow | /annuaire |
| Disallow | /rate-recipes* |
| Disallow | /noter-les-recettes* |
| Disallow | /vota-ricette* |
| Disallow | /votar-nas-receitas* |
| Disallow | /voteaza-retete* |
| Disallow | /votar-nas-receitas* |
| Disallow | /calificar-recetas* |
| Disallow | /components/ |
| Disallow | /modules/ |
| Disallow | /*/components/ |
| Disallow | /*/modules/ |
| Disallow | /prahu/ |
| Disallow | /ooze/ |
| Disallow | /fake-adback-endpoint/ |
| Allow | /*?obj=feed* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pt.petitchef.com/sitemap.xml |