recettesdici.com
robots.txt
Robots Exclusion Standard data for recettesdici.com
Resource Scan
Scan Details
| Site Domain | recettesdici.com |
| Base Domain | recettesdici.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T09:53:07+00:00 |
| Next Scan | 2024-10-23T09:53:07+00:00 |
Last Scan
| Scanned | 2024-09-23T09:53:07+00:00 |
| URL | https://recettesdici.com/robots.txt |
| Redirect | https://www.recettesdici.com/robots.txt |
| Redirect Domain | www.recettesdici.com |
| Redirect Base | recettesdici.com |
| Domain IPs | 13.251.96.10, 18.139.194.139 |
| Redirect IPs | 13.215.144.61, 52.74.166.77 |
| Response IP | 13.215.144.61 |
| Found | Yes |
| Hash | 8077081f3593d9df96547bbad982300127d5e6bcd0f98be4859830040c0f1b73 |
| SimHash | 62094862c691 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /fr/vide-frigo/resultats |
| Disallow | /fr/recherche |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.recettesdici.com/sitemap.xml |
Comments