h3manth.com
robots.txt

Robots Exclusion Standard data for h3manth.com

Resource Scan

Scan Details

Site Domain h3manth.com
Base Domain h3manth.com
Scan Status Ok
Last Scan2025-07-22T21:04:13+00:00
Next Scan 2025-08-21T21:04:13+00:00

Last Scan

Scanned2025-07-22T21:04:13+00:00
URL https://h3manth.com/robots.txt
Domain IPs 104.21.22.89, 172.67.203.196, 2606:4700:3034::ac43:cbc4, 2606:4700:3035::6815:1659
Response IP 104.21.22.89
Found Yes
Hash a561aba7557f1cb839fb816ac6316df31ed7bce93644798468b3ef6a5f6ca1c1
SimHash 9d145d384c52

Groups

*

Rule Path
Allow /
Disallow /boost_stats.php
Disallow /i/
Disallow /database/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /sites/
Disallow /sites/all/modules
Disallow /themes/
Disallow /scripts/
Disallow /updates/
Disallow /profiles/
Disallow /xmlrpc.php
Disallow /cron.php
Disallow /update.php
Disallow /install.php
Disallow /INSTALL.txt
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /CHANGELOG.txt
Disallow /MAINTAINERS.txt
Disallow /LICENSE.txt
Disallow /UPGRADE.txt
Disallow /admin/
Disallow /aggregator
Disallow /comment/reply/
Disallow /contact
Disallow /logout
Disallow /node/add
Disallow /search/
Disallow /search$
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /?q=admin%2F
Disallow /?q=aggregator
Disallow /?q=comment%2Freply%2F
Disallow /?q=contact
Disallow /?q=logout
Disallow /?q=node%2Fadd
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword
Disallow /?q=user%2Fregister
Disallow /?q=user%2Flogin
Disallow /node$
Disallow /user$
Disallow /*sort%3D
Disallow /search$
Disallow /*/feed$
Disallow /*/track$
Disallow /tracker?
Disallow /filter/

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Additional Rules
  • If you don't want the bulk of your "recent posts" pages indexed, add this: