dentaleh.com
robots.txt

Robots Exclusion Standard data for dentaleh.com

Resource Scan

Scan Details

Site Domain dentaleh.com
Base Domain dentaleh.com
Scan Status Ok
Last Scan5/24/2025, 6:56:34 AM
Next Scan 5/31/2025, 6:56:34 AM

Last Scan

Scanned5/24/2025, 6:56:34 AM
URL https://dentaleh.com/robots.txt
Domain IPs 104.21.76.233, 172.67.202.19, 2606:4700:3034::ac43:ca13, 2606:4700:3037::6815:4ce9
Response IP 104.21.76.233
Found Yes
Hash ada114326bceb25902a34511af8ab4c1336c37a0509d123ab1e55840d71c30fb
SimHash 52bc5f0cced8

Groups

*

Rule Path
Disallow /taxonomy/term/all/
Disallow /user
Disallow /dental-a-z/
Disallow /includes/
Disallow /modules/
Disallow /libraries/
Disallow /profiles/
Disallow /scripts/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dentaleh.com/sitemap.xml

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)