kangalgundem.com
robots.txt

Robots Exclusion Standard data for kangalgundem.com

Resource Scan

Scan Details

Site Domain kangalgundem.com
Base Domain kangalgundem.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-01T22:09:53+00:00
Next Scan 2025-11-08T22:09:53+00:00

Last Successful Scan

Scanned2025-10-23T08:24:46+00:00
URL https://kangalgundem.com/robots.txt
Domain IPs 104.21.8.87, 172.67.139.14, 2606:4700:3035::6815:857, 2606:4700:3037::ac43:8b0e
Response IP 172.67.139.14
Found Yes
Hash 07a13ef1883722dcf5722c6b5f4cb5ad75f7f5b2bd75f2f22b2da80f98d2e0c1
SimHash d99caa11cc9a

Groups

*

Rule Path
Disallow /haberleri?filter=
Disallow /etiket?filter=
Disallow /paylas
Disallow /paylas?
Disallow /yazdir/
Disallow /ara
Allow /

googlebot-image

Rule Path
Disallow /user
Disallow /themes/enerjik/assets/
Disallow /themes/enerjik/assets/
Allow /

adsbot-google

Rule Path
Disallow /service/stats/visitors
Disallow /service/advertchannels
Allow /

Other Records

Field Value
sitemap https://kangalgundem.com/google-news.xml
sitemap https://kangalgundem.com/sitemap.xml
sitemap https://kangalgundem.com/sitemap-latest.xml