web.baneeh.com
robots.txt

Robots Exclusion Standard data for web.baneeh.com

Resource Scan

Scan Details

Site Domain web.baneeh.com
Base Domain baneeh.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-17T10:02:34+00:00
Next Scan 2025-11-15T10:02:34+00:00

Last Successful Scan

Scanned2022-10-01T01:24:04+00:00
URL https://web.baneeh.com/robots.txt
Redirect https://baneeh.com/robots.txt
Redirect Domain baneeh.com
Redirect Base baneeh.com
Response IP 172.67.191.100, 104.21.81.220
Found Yes
Hash c60a14481e0ff652fee5f8c58f153471cfa45467ff1723916196b43add70b28f
SimHash ad36fc5dc7f1

Groups

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /js/
Disallow /lib/
Disallow /magento/
Disallow /media/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /var/
Disallow /index.php/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /sendfriend/
Disallow /tag/
Disallow /catalog/product/gallery/
Disallow /porto_*
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /*?SID=

Other Records

Field Value
sitemap https://baneeh.com/sitemap.xml

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)