avi-hadbarot.com
robots.txt

Robots Exclusion Standard data for avi-hadbarot.com

Resource Scan

Scan Details

Site Domain avi-hadbarot.com
Base Domain avi-hadbarot.com
Scan Status Ok
Last Scan2026-02-24T03:16:07+00:00
Next Scan 2026-03-26T03:16:07+00:00

Last Scan

Scanned2026-02-24T03:16:07+00:00
URL https://avi-hadbarot.com/robots.txt
Domain IPs 104.21.69.208, 172.67.213.25, 2606:4700:3035::6815:45d0, 2606:4700:3037::ac43:d519
Response IP 172.67.213.25
Found Yes
Hash ca93d86824b67cf13ee7032a8f468307e5c8cd3f2eed4a7816299df1fae42997
SimHash 6b455c87e111

Groups

oai-searchbot

Rule Path Comment
Allow / -
Disallow /wp-admin -
Disallow /wp-content/plugins/ block access to plugins
Disallow /wp-login.php block access to management
Disallow /feed block feeds
Disallow /search/ block internal search results
Disallow /?s= block access to internal search result pages
Disallow /tag/ block tags
Disallow /author/ blocking author pages

chatgpt-user

Rule Path Comment
Allow / -
Disallow /wp-admin -
Disallow /wp-content/plugins/ block access to plugins
Disallow /wp-login.php block access to management
Disallow /feed block feeds
Disallow /search/ block internal search results
Disallow /?s= block access to internal search result pages
Disallow /%26preview%3D block preview
Disallow /tag/ block tags
Disallow /author/ blocking author pages

gptbot

Rule Path Comment
Allow / -
Disallow /wp-admin -
Disallow /wp-content/plugins/ block access to plugins
Disallow /wp-login.php block access to management
Disallow /feed block feeds
Disallow /search/ block internal search results
Disallow /?s= block access to internal search result pages
Disallow /%26preview%3D block preview
Disallow /tag/ block tags
Disallow /author/ blocking author pages

*

Rule Path Comment
Allow / -
Disallow /wp-admin -
Disallow /wp-content/plugins/ block access to plugins
Disallow /wp-login.php block access to management
Disallow /feed block feeds
Disallow /search/ block internal search results
Disallow /?s= block access to internal search result pages
Disallow /%26preview%3D block preview
Disallow /tag/ block tags
Disallow /author/ blocking author pages

Other Records

Field Value
sitemap https://www.avi-hadbarot.com/sitemap_index.xml