efelerhaber.com
robots.txt

Robots Exclusion Standard data for efelerhaber.com

Resource Scan

Scan Details

Site Domain efelerhaber.com
Base Domain efelerhaber.com
Scan Status Ok
Last Scan4/13/2025, 8:17:22 AM
Next Scan 4/20/2025, 8:17:22 AM

Last Scan

Scanned4/13/2025, 8:17:22 AM
URL https://efelerhaber.com/robots.txt
Redirect https://www.efelerhaber.com/robots.txt
Redirect Domain www.efelerhaber.com
Redirect Base efelerhaber.com
Domain IPs 104.21.83.13, 172.67.166.197, 2606:4700:3031::6815:530d, 2606:4700:3034::ac43:a6c5
Redirect IPs 104.21.83.13, 172.67.166.197, 2606:4700:3031::6815:530d, 2606:4700:3034::ac43:a6c5
Response IP 104.21.83.13
Found Yes
Hash 0525d16a8d6de174d4a5fef1c8ffa41c665c1aa2e54de48f6469001773befe69
SimHash 81181433ee13

Groups

*

Rule Path
Disallow /arama
Disallow /public
Disallow /public/*
Disallow /service*
Disallow /share*
Disallow /tr/*
Disallow /*?ref=
Disallow /*?q=
Disallow /*?preview=
Disallow /*?utm_source=
Disallow /*?page=
Disallow /*?cursor=
Allow /

adsbot-google

Rule Path
Disallow /advert/*
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://erdem.habertest.com/sitemap.xml