foodindustry.kz
robots.txt
Robots Exclusion Standard data for foodindustry.kz
Resource Scan
Scan Details
Site Domain | foodindustry.kz |
Base Domain | foodindustry.kz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-01-06T14:13:34+00:00 |
Next Scan | 2025-04-06T14:13:34+00:00 |
Last Successful Scan
Scanned | 2024-05-19T09:07:05+00:00 |
URL | https://foodindustry.kz/robots.txt |
Domain IPs | 104.21.68.164, 172.67.196.227, 2606:4700:3030::6815:44a4, 2606:4700:3031::ac43:c4e3 |
Response IP | 104.21.68.164 |
Found | Yes |
Hash | ba774182769c9d691a2609e439b3403969b243a020061ee0e1c4c3250450cbf2 |
SimHash | c944c880a01a |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://foodindustry.kz/sitemap_index.xml |
Comments