Log In Sign Up

hepsibahis.com
robots.txt

Robots Exclusion Standard data for hepsibahis.com

Resource Scan

Scan Details

Site Domain hepsibahis.com
Base Domain hepsibahis.com
Scan Status Ok
Last Scan2026-01-15T05:00:48+00:00
Next Scan 2026-02-14T05:00:48+00:00

Last Scan

Scanned2026-01-15T05:00:48+00:00
URL https://www.hepsibahis.com/robots.txt
Redirect https://tr.hepsibahis.com/robots.txt
Redirect Domain tr.hepsibahis.com
Redirect Base hepsibahis.com
Domain IPs 104.26.10.32, 104.26.11.32, 172.67.72.104, 2606:4700:20::681a:a20, 2606:4700:20::681a:b20, 2606:4700:20::ac43:4868
Redirect IPs 104.26.10.32, 104.26.11.32, 172.67.72.104, 2606:4700:20::681a:a20, 2606:4700:20::681a:b20, 2606:4700:20::ac43:4868
Response IP 104.26.11.32
Found Yes
Hash b3d18b8719e04e332817469563178bd4cb86d6422ed577951b88141febe13b66
SimHash 219c8ad167e1

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandex

Rule Path
Allow /

baiduspider

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /
Back to top

Comments

  • --- Explicit Google permissions (AMP, Images, Ads, etc.) ---
  • --- Major search engines ---
  • --- AI & data crawlers (explicitly allowed) ---
Back to top

Warnings

  • `content-signal` is not a known field.
Back to top