kent04.com
robots.txt

Robots Exclusion Standard data for kent04.com

Resource Scan

Scan Details

Site Domain kent04.com
Base Domain kent04.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-27T18:49:24+00:00
Next Scan 2026-02-25T18:49:24+00:00

Last Successful Scan

Scanned2025-10-28T11:09:38+00:00
URL https://kent04.com/robots.txt
Redirect https://www.kent04.com/robots.txt
Redirect Domain www.kent04.com
Redirect Base kent04.com
Domain IPs 104.21.10.182, 172.67.190.199, 2606:4700:3033::6815:ab6, 2606:4700:3036::ac43:bec7
Redirect IPs 104.21.10.182, 172.67.190.199, 2606:4700:3033::6815:ab6, 2606:4700:3036::ac43:bec7
Response IP 104.21.10.182
Found Yes
Hash 87c7b5cbf062ab9c9f5bd1f05c49221d7d9a2f377419199844b3ae2dbb929289
SimHash 419cae11ce92

Groups

*

Rule Path
Disallow /haberleri?filter=
Disallow /etiket?filter=
Disallow /paylas
Disallow /paylas?
Disallow /yazdir/
Disallow /ara
Allow /

googlebot-image

Rule Path
Disallow /user
Disallow /themes/enerjik/assets/
Disallow /themes/enerjik/assets/
Allow /

adsbot-google

Rule Path
Disallow /service/stats/visitors
Disallow /service/advertchannels
Allow /

Other Records

Field Value
sitemap https://www.kent04.com/google-news.xml
sitemap https://www.kent04.com/sitemap.xml
sitemap https://www.kent04.com/sitemap-latest.xml