grow.mn
robots.txt

Robots Exclusion Standard data for grow.mn

Resource Scan

Scan Details

Site Domain grow.mn
Base Domain grow.mn
Scan Status Ok
Last Scan2026-01-12T04:43:24+00:00
Next Scan 2026-02-11T04:43:24+00:00

Last Scan

Scanned2026-01-12T04:43:24+00:00
URL https://grow.mn/robots.txt
Domain IPs 104.21.39.39, 172.67.142.175, 2606:4700:3033::6815:2727, 2606:4700:3034::ac43:8eaf
Response IP 172.67.142.175
Found Yes
Hash d851bab46aaa170a676b6a80253e3746767b3999348ff02dc591cdb043440ec2
SimHash 51a07ac54ff7

Groups

squirrlybot

Rule Path
Disallow

*

Rule Path
Disallow */trackback/
Disallow */xmlrpc.php
Disallow /wp-*.php
Disallow /cgi-bin/
Disallow /wp-admin/
Allow */wp-content/uploads/

Other Records

Field Value
sitemap https://grow.mn/sitemap.xml
sitemap https://grow.mn/sitemap-home.xml
sitemap https://grow.mn/sitemap-posts.xml
sitemap https://grow.mn/sitemap-pages.xml
sitemap https://grow.mn/sitemap-categories.xml
sitemap https://grow.mn/sitemap-tags.xml
sitemap https://grow.mn/sitemap-archives.xml
sitemap https://grow.mn/sitemap-custom-taxonomies.xml
sitemap https://grow.mn/sitemap-custom-posts.xml
sitemap https://grow.mn/sitemap.xml
sitemap https://grow.mn/sitemap-home.xml
sitemap https://grow.mn/sitemap-posts.xml
sitemap https://grow.mn/sitemap-pages.xml
sitemap https://grow.mn/sitemap-categories.xml
sitemap https://grow.mn/sitemap-tags.xml
sitemap https://grow.mn/sitemap-archives.xml
sitemap https://grow.mn/sitemap-custom-taxonomies.xml
sitemap https://grow.mn/sitemap-custom-posts.xml

Comments

  • Robots
  • Robots
  • Allow Squirrly crawler
  • Default rules for all bots

Warnings

  • 2 invalid lines.