divanekherad.com
robots.txt

Robots Exclusion Standard data for divanekherad.com

Resource Scan

Scan Details

Site Domain divanekherad.com
Base Domain divanekherad.com
Scan Status Ok
Last Scan2026-01-07T19:14:38+00:00
Next Scan 2026-02-06T19:14:38+00:00

Last Scan

Scanned2026-01-07T19:14:38+00:00
URL https://divanekherad.com/robots.txt
Domain IPs 137.74.182.131
Response IP 137.74.182.131
Found Yes
Hash 70abe4ab82d16220fe47f831f9ba9952bc65c2da1006e63a63253655b43e1829
SimHash 4b48d1ee6bb1

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow */feed/
Disallow /?s=*
Disallow /refer/
Disallow /old/
Disallow /newver/

Other Records

Field Value
sitemap https://divanekherad.com/sitemap_index.xml

Comments

  • Allow necessary resources
  • Disallow admin and core WordPress areas
  • Disallow unnecessary files for security
  • Disallow plugin and theme core files
  • Disallow paths that can cause duplicate content
  • Your custom directories to disallow
  • Sitemap location