web.azkharid.com
robots.txt

Robots Exclusion Standard data for web.azkharid.com

Resource Scan

Scan Details

Site Domain web.azkharid.com
Base Domain azkharid.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-21T11:33:33+00:00
Next Scan 2025-11-19T11:33:33+00:00

Last Successful Scan

Scanned2022-10-04T02:01:37+00:00
URL https://web.azkharid.com/robots.txt
Redirect https://baneeh.com/robots.txt
Redirect Domain baneeh.com
Redirect Base baneeh.com
Response IP 104.21.81.220, 172.67.191.100
Found Yes
Hash bb3430a4d00463cd635900847dd8a3c700ad6e8c37afdd32436777c63b2399d6
SimHash a926f8cdc3f1

Groups

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /js/
Disallow /lib/
Disallow /magento/
Disallow /media/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /var/
Disallow /index.php/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /sendfriend/
Disallow /tag/
Disallow /catalog/product/gallery/
Disallow /porto_*
Disallow /productalert/
Disallow /wishlist/
Disallow /product_compare/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /*?SID=

Other Records

Field Value
sitemap https://baneeh.com/sitemap.xml

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)