sarigolgundem.com
robots.txt

Robots Exclusion Standard data for sarigolgundem.com

Resource Scan

Scan Details

Site Domain sarigolgundem.com
Base Domain sarigolgundem.com
Scan Status Ok
Last Scan2025-05-30T09:37:35+00:00
Next Scan 2025-06-06T09:37:35+00:00

Last Scan

Scanned2025-05-30T09:37:35+00:00
URL https://sarigolgundem.com/robots.txt
Redirect https://www.manisaaktifhaber.com.tr/robots.txt
Redirect Domain www.manisaaktifhaber.com.tr
Redirect Base manisaaktifhaber.com.tr
Domain IPs 104.21.79.219, 172.67.171.143, 2606:4700:3030::6815:4fdb, 2606:4700:3033::ac43:ab8f
Redirect IPs 104.21.42.117, 172.67.161.215, 2606:4700:3033::ac43:a1d7, 2606:4700:3035::6815:2a75
Response IP 104.21.42.117
Found Yes
Hash 91950626fd3c36dadffd8917594d98ce9446ecea034f27573209fa8d3dfde8aa
SimHash 08401ce6c292

Groups

*

Rule Path
Disallow /public
Disallow /public/*
Disallow /service*
Disallow /arama/
Disallow /api
Disallow /*?q=
Disallow /*?preview=
Disallow /*?utm_source=
Disallow /*?page=
Disallow /*%26page%3D
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /service/
Disallow /advert/*
Disallow /*model%3DTE%5C
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/

adsbot-google

Rule Path
Disallow /advert/*
Allow /

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

applebot

Rule Path
Disallow /vendor/
Disallow /media/
Disallow /public/
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/

Other Records

Field Value
sitemap https://www.manisaaktifhaber.com.tr/sitemap.xml
sitemap https://www.manisaaktifhaber.com.tr/sitemap-news.xml
sitemap https://www.manisaaktifhaber.com.tr/rss?yandex=turbo

Warnings

  • `clean-param` is not a known field.