lesfoodies.com
robots.txt
Robots Exclusion Standard data for lesfoodies.com
Resource Scan
Scan Details
Site Domain | lesfoodies.com |
Base Domain | lesfoodies.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-31T05:29:41+00:00 |
Next Scan | 2024-10-29T05:29:41+00:00 |
Last Successful Scan
Scanned | 2023-10-06T00:58:41+00:00 |
URL | https://lesfoodies.com/robots.txt |
Domain IPs | 94.75.230.101 |
Response IP | 94.75.230.101 |
Found | Yes |
Hash | 639593ef475402c309a60a2fa61fa16c3bddc060d81c0a9f85343ae1eaaf264d |
SimHash | 7460c71147d0 |
Groups
*
Rule | Path |
---|---|
Allow | /mod/template/icons/rss.png |
Disallow | */rss* |
Disallow | /_invite/register.php |
Disallow | /_invite/forgotten_password.php |
Disallow | /content/faq.php |
Disallow | /_rpc/rsd.php?user_id=* |
Disallow | /_crons/* |