sanliurfaolay.com
robots.txt

Robots Exclusion Standard data for sanliurfaolay.com

Resource Scan

Scan Details

Site Domain sanliurfaolay.com
Base Domain sanliurfaolay.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-24T15:00:40+00:00
Next Scan 2026-02-22T15:00:40+00:00

Last Successful Scan

Scanned2025-10-24T02:57:52+00:00
URL https://sanliurfaolay.com/robots.txt
Redirect https://www.sanliurfaolay.com/robots.txt
Redirect Domain www.sanliurfaolay.com
Redirect Base sanliurfaolay.com
Domain IPs 104.21.19.204, 172.67.190.46, 2606:4700:3034::6815:13cc, 2606:4700:3035::ac43:be2e
Redirect IPs 104.21.19.204, 172.67.190.46, 2606:4700:3034::6815:13cc, 2606:4700:3035::ac43:be2e
Response IP 172.67.190.46
Found Yes
Hash 7035ca526bc2d76db4fa0b23fb8544e1069db9b845d5c32c2ea88e193b123801
SimHash c19caa10ce92

Groups

*

Rule Path
Disallow /haberleri?filter=
Disallow /etiket?filter=
Disallow /paylas
Disallow /paylas?
Disallow /yazdir/
Disallow /ara
Allow /

googlebot-image

Rule Path
Disallow /user
Disallow /themes/enerjik/assets/
Disallow /themes/enerjik/assets/
Allow /

adsbot-google

Rule Path
Disallow /service/stats/visitors
Disallow /service/advertchannels
Allow /

Other Records

Field Value
sitemap https://www.sanliurfaolay.com/google-news.xml
sitemap https://www.sanliurfaolay.com/sitemap.xml
sitemap https://www.sanliurfaolay.com/sitemap-latest.xml