khoshkobar.com
robots.txt

Robots Exclusion Standard data for khoshkobar.com

Resource Scan

Scan Details

Site Domain khoshkobar.com
Base Domain khoshkobar.com
Scan Status Ok
Last Scan2026-02-07T02:28:55+00:00
Next Scan 2026-03-09T02:28:55+00:00

Last Scan

Scanned2026-02-07T02:28:55+00:00
URL https://khoshkobar.com/robots.txt
Domain IPs 89.32.248.162
Response IP 89.32.248.162
Found Yes
Hash 68fe69c53a876eebb939570ad370aa56571e5583e6a676cb7f432ace9fddfac6
SimHash 6194395089b9

Groups

*

Rule Path
Disallow /wp-admin/
Disallow */feed
Disallow /cgi-bin
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow */?wordfence_lh=1*
Disallow /*.html$
Disallow /*.shtml$
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://khoshkobar.com/sitemap.xml

Comments

  • وردپرس
  • جلوگیری از ایندکس صفحات با پسوند html و shtml
  • Cloudflare Managed Content (برای ربات‌های خاص)