Log In Sign Up

minfi.cm
robots.txt

Robots Exclusion Standard data for minfi.cm

Resource Scan

Scan Details

Site Domain minfi.cm
Base Domain minfi.cm
Scan Status Ok
Last Scan2025-09-08T22:35:08+00:00
Next Scan 2025-09-15T22:35:08+00:00

Last Scan

Scanned2025-09-08T22:35:08+00:00
URL https://www.minfi.cm/robots.txt
Domain IPs 195.24.205.37
Response IP 195.24.205.37
Found Yes
Hash 421f537d2a67fe348e61795328f2732864ddbf3ac29cd46e43ea89ace15e6f4e
SimHash ad449b13c5d5

Groups

googlebot

Rule Path
Disallow /channel/
Disallow /user/

anothercrawler

Rule Path
Disallow /
Back to top

Comments

  • Block googlebot from example.com/directory1/... and example.com/directory2/...
  • but allow access to directory2/subdirectory1/...
  • All other directories on the site are allowed by default.
  • Block the entire site from anothercrawler.
Back to top