onefineart.com
robots.txt

Robots Exclusion Standard data for onefineart.com

Resource Scan

Scan Details

Site Domain onefineart.com
Base Domain onefineart.com
Scan Status Ok
Last Scan2025-04-18T05:36:26+00:00
Next Scan 2025-04-25T05:36:26+00:00

Last Scan

Scanned2025-04-18T05:36:26+00:00
URL https://onefineart.com/robots.txt
Redirect http://www.onefineart.com/robots.txt
Redirect Domain www.onefineart.com
Redirect Base onefineart.com
Domain IPs 104.21.63.139, 172.67.146.17, 2606:4700:3035::ac43:9211, 2606:4700:3036::6815:3f8b
Redirect IPs 104.21.63.139, 172.67.146.17, 2606:4700:3035::ac43:9211, 2606:4700:3036::6815:3f8b
Response IP 172.67.146.17
Found Yes
Hash c42be702ce72c807d76178bb733bfcdbcf5e8c41a7ec9d861c8f0a7b6d476624
SimHash e026193763b1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.onefineart.com/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin