Log In Sign Up

mgorod.kz
robots.txt

Robots Exclusion Standard data for mgorod.kz

Resource Scan

Scan Details

Site Domain mgorod.kz
Base Domain mgorod.kz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-26T19:28:57+00:00
Next Scan 2024-12-25T19:28:57+00:00

Last Successful Scan

Scanned2023-12-02T19:27:15+00:00
URL https://mgorod.kz/robots.txt
Domain IPs 104.21.39.132, 172.67.145.207, 2606:4700:3030::ac43:91cf, 2606:4700:3031::6815:2784
Response IP 104.21.39.132
Found Yes
Hash 3b80971e294b8943b8127c71560936446c23a9a017a0b6676affbc1d5e7905d6
SimHash 433296610673

Groups

*

Rule Path
Allow /
Allow /wp-content
Allow /wp-content/themes
Back to top

Other Records

Field Value
sitemap https://mgorod.kz/sitemap_index.xml
Back to top

Comments

  • Allow: */uploads
  • Allow: */wp-content
  • Allow: /wp-content/themes/mgorod/assets/images/logo/*
  • Disallow: /cgi-bin
  • Disallow: /wp-admin
  • Disallow: *?s=
  • Disallow: *?attachment_id=
  • Disallow: /xmlrpc.php
  • Disallow: /bannery
  • Disallow: /feed
  • Disallow: /wp-content/uploads/wp-import-export-lite/
  • Disallow: /register
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top