artf4.com
robots.txt

Robots Exclusion Standard data for artf4.com

Resource Scan

Scan Details

Site Domain artf4.com
Base Domain artf4.com
Scan Status Ok
Last Scan2025-12-21T19:04:25+00:00
Next Scan 2026-01-20T19:04:25+00:00

Last Scan

Scanned2025-12-21T19:04:25+00:00
URL https://artf4.com/robots.txt
Domain IPs 104.21.11.247, 172.67.193.72, 2606:4700:3037::6815:bf7, 2606:4700:3037::ac43:c148
Response IP 104.21.11.247
Found Yes
Hash 8e656563802e474b62c801386e42e2cee2a676d93266eb6c4aa3e6aa394c3422
SimHash 8d904e47e360

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /filament/
Disallow /storage/
Disallow /vendor/
Disallow /bootstrap/
Disallow /config/
Disallow /database/
Disallow /resources/
Disallow /tests/
Disallow /node_modules/
Disallow /.env
Disallow /.git/
Disallow /composer.json
Disallow /composer.lock
Disallow /package.json
Disallow /package-lock.json
Disallow /vite.config.js
Disallow /tailwind.config.js
Disallow /phpunit.xml
Disallow /artisan
Disallow /cookies.txt
Disallow /api/
Disallow /language/
Disallow /*.tmp$
Disallow /*.log$
Disallow /*.cache$

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://artf4.com/sitemap.xml

Comments

  • ArtF4 - Dijital Dönüşüm ve Yazılım Geliştirme
  • Robots.txt - SEO Optimizasyonu
  • Tüm botlara izin ver
  • Admin paneli ve hassas alanları engelle
  • API endpoint'lerini engelle (gerekirse)
  • Dil değiştirme URL'lerini engelle
  • Geçici dosyaları engelle
  • Sitemap konumu
  • Crawl delay (isteğe bağlı)