lesfoodies.com
robots.txt
Robots Exclusion Standard data for lesfoodies.com
Resource Scan
Scan Details
| Site Domain | lesfoodies.com |
| Base Domain | lesfoodies.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-02T05:29:18+00:00 |
| Next Scan | 2024-07-31T05:29:18+00:00 |
Last Successful Scan
| Scanned | 2023-10-06T00:58:41+00:00 |
| URL | https://lesfoodies.com/robots.txt |
| Domain IPs | 94.75.230.101 |
| Response IP | 94.75.230.101 |
| Found | Yes |
| Hash | 639593ef475402c309a60a2fa61fa16c3bddc060d81c0a9f85343ae1eaaf264d |
| SimHash | 7460c71147d0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /mod/template/icons/rss.png |
| Disallow | */rss* |
| Disallow | /_invite/register.php |
| Disallow | /_invite/forgotten_password.php |
| Disallow | /content/faq.php |
| Disallow | /_rpc/rsd.php?user_id=* |
| Disallow | /_crons/* |