setav.org
robots.txt

Robots Exclusion Standard data for setav.org

Resource Scan

Scan Details

Site Domain setav.org
Base Domain setav.org
Scan Status Ok
Last Scan2026-01-02T10:25:49+00:00
Next Scan 2026-02-01T10:25:49+00:00

Last Scan

Scanned2026-01-02T10:25:49+00:00
URL https://setav.org/robots.txt
Redirect https://www.setav.org/robots.txt
Redirect Domain www.setav.org
Redirect Base setav.org
Domain IPs 104.21.85.160, 172.67.207.161, 2606:4700:3032::ac43:cfa1, 2606:4700:3033::6815:55a0
Redirect IPs 104.21.85.160, 172.67.207.161, 2606:4700:3032::ac43:cfa1, 2606:4700:3033::6815:55a0
Response IP 104.21.85.160
Found Yes
Hash 30e794d6afaccd925e33bc831184b51eb1a5e71cfccdf8fdef11eb7842890c96
SimHash 690cc5431d25

Groups

*

Rule Path
Allow /
Disallow /en/search?
Disallow /arama?

Other Records

Field Value
sitemap https://www.setav.org/sitemap/sayfalar
sitemap https://www.setav.org/sitemap/kategoriler
sitemap https://www.setav.org/sitemap/etiketler
sitemap https://www.setav.org/sitemap/yayinlar
sitemap https://www.setav.org/sitemap/yazarlar
sitemap https://www.setav.org/en/sitemap/sayfalar
sitemap https://www.setav.org/en/sitemap/kategoriler
sitemap https://www.setav.org/en/sitemap/etiketler
sitemap https://www.setav.org/en/sitemap/yayinlar
sitemap https://www.setav.org/en/sitemap/yazarlar