damanturk.com
robots.txt

Robots Exclusion Standard data for damanturk.com

Resource Scan

Scan Details

Site Domain damanturk.com
Base Domain damanturk.com
Scan Status Ok
Last Scan2025-04-04T03:48:10+00:00
Next Scan 2025-05-04T03:48:10+00:00

Last Scan

Scanned2025-04-04T03:48:10+00:00
URL https://damanturk.com/robots.txt
Domain IPs 91.204.209.29
Response IP 91.204.209.29
Found Yes
Hash bfdbf42ca85aafe9f2f91bf722b14405fe576ac8b0a37242db25c5568051b571
SimHash c42e193343a1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://damanturk.com/tr/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin