parvatjan.com
robots.txt

Robots Exclusion Standard data for parvatjan.com

Resource Scan

Scan Details

Site Domain parvatjan.com
Base Domain parvatjan.com
Scan Status Ok
Last Scan2025-10-31T03:50:11+00:00
Next Scan 2025-11-30T03:50:11+00:00

Last Scan

Scanned2025-10-31T03:50:11+00:00
URL https://parvatjan.com/robots.txt
Domain IPs 104.21.11.30, 172.67.165.24, 2606:4700:3030::6815:b1e, 2606:4700:3036::ac43:a518
Response IP 104.21.11.30
Found Yes
Hash a5d680f33bd7e24c74c949ca91c3703f312ceafdb7207ba7ebef81b8f0fbabdc
SimHash a004093303a1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://parvatjan.com/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin