magazine.mindplex.ai
robots.txt

Robots Exclusion Standard data for magazine.mindplex.ai

Resource Scan

Scan Details

Site Domain magazine.mindplex.ai
Base Domain mindplex.ai
Scan Status Ok
Last Scan2026-02-20T20:33:51+00:00
Next Scan 2026-03-22T20:33:51+00:00

Last Scan

Scanned2026-02-20T20:33:51+00:00
URL https://magazine.mindplex.ai/robots.txt
Domain IPs 104.21.84.57, 172.67.187.27, 2606:4700:3030::6815:5439, 2606:4700:3032::ac43:bb1b
Response IP 172.67.187.27
Found Yes
Hash 2d2f824ed7358b713567351f8636c419056b8889061bb9b4c20c78d9f3e2034d
SimHash 23215e32a501

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$
Allow /images/
Allow /assets/

Other Records

Field Value
sitemap https://magazine.mindplex.ai/sitemap.xml

Comments

  • Allow crawling of images
  • Allow common assets
  • Sitemap location
  • Disallow admin or private areas (if any)
  • Disallow: /admin/
  • Disallow: /api/