definearevolution.com
robots.txt

Robots Exclusion Standard data for definearevolution.com

Resource Scan

Scan Details

Site Domain definearevolution.com
Base Domain definearevolution.com
Scan Status Ok
Last Scan2025-12-26T08:02:36+00:00
Next Scan 2026-01-02T08:02:36+00:00

Last Scan

Scanned2025-12-26T08:02:36+00:00
URL https://definearevolution.com/robots.txt
Domain IPs 104.21.25.151, 172.67.134.85, 2606:4700:3031::6815:1997, 2606:4700:3034::ac43:8655
Response IP 104.21.25.151
Found Yes
Hash 6e761d1da5f6e0b3ca221e582bbfdb52e80c5c34d3cc3756846999f1317845cb
SimHash 8424093323a1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://definearevolution.com/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin