roknelbeet.com
robots.txt

Robots Exclusion Standard data for roknelbeet.com

Resource Scan

Scan Details

Site Domain roknelbeet.com
Base Domain roknelbeet.com
Scan Status Ok
Last Scan2025-12-25T05:48:26+00:00
Next Scan 2026-01-24T05:48:26+00:00

Last Scan

Scanned2025-12-25T05:48:26+00:00
URL https://roknelbeet.com/robots.txt
Domain IPs 72.62.95.124
Response IP 72.62.95.124
Found Yes
Hash 4c2d4d7b961139025dbf7758cb89ea92c05abd74a1ea25b59ae6e1145105e723
SimHash c50e093723b1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.roknelbeet.com/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin