foodindustry.kz
robots.txt

Robots Exclusion Standard data for foodindustry.kz

Resource Scan

Scan Details

Site Domain foodindustry.kz
Base Domain foodindustry.kz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-06T14:13:34+00:00
Next Scan 2025-04-06T14:13:34+00:00

Last Successful Scan

Scanned2024-05-19T09:07:05+00:00
URL https://foodindustry.kz/robots.txt
Domain IPs 104.21.68.164, 172.67.196.227, 2606:4700:3030::6815:44a4, 2606:4700:3031::ac43:c4e3
Response IP 104.21.68.164
Found Yes
Hash ba774182769c9d691a2609e439b3403969b243a020061ee0e1c4c3250450cbf2
SimHash c944c880a01a

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /wp-json/
Disallow /?rest_route=

adsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://foodindustry.kz/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK