Log In Sign Up

hesapustam.com
robots.txt

Robots Exclusion Standard data for hesapustam.com

Resource Scan

Scan Details

Site Domain hesapustam.com
Base Domain hesapustam.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-28T00:04:06+00:00
Next Scan 2026-02-26T00:04:06+00:00

Last Successful Scan

Scanned2025-10-28T15:36:54+00:00
URL https://hesapustam.com/robots.txt
Domain IPs 2a02:4780:84:6eeb:20e4:b83f:48e4:cf43, 2a02:4780:84:bd87:a730:f099:2e6d:ee7d, 77.37.75.25, 93.127.201.242
Response IP 191.101.228.185
Found Yes
Hash e2d01c0d9b049433edf7072ac03749e9d1eb27986897f0171b0bd2b576ad2af6
SimHash 7b2d4f5547d4

Groups

*

Rule Path
Disallow /admin/
Disallow /includes/
Disallow /private/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /scripts/
Disallow /config.php
Disallow /db.php
Disallow /database/
Disallow /backup/
Disallow /uploads/
Disallow /*?session=
Disallow /*?ref=
Back to top

Other Records

Field Value
sitemap https://www.hesapustam.com/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.hesapustam.com/
  • Genel Kurallar
  • Özel Dosyalar ve Diziler
  • URL Parametrelerini Engelleme (Opsiyonel)
  • Sitemap Dosyasının Konumu
  • Crawl-delay (Opsiyonel)
  • Crawl-delay: 10
  • Özel Kurallar (Opsiyonel)
  • User-agent: Googlebot
  • Allow: /public/
  • User-agent: Bingbot
  • Disallow: /
  • User-agent: Yandex
  • Allow: /
Back to top