sharonlockwood.com
robots.txt

Robots Exclusion Standard data for sharonlockwood.com

Resource Scan

Scan Details

Site Domain sharonlockwood.com
Base Domain sharonlockwood.com
Scan Status Ok
Last Scan2025-06-13T02:40:34+00:00
Next Scan 2025-06-20T02:40:34+00:00

Last Scan

Scanned2025-06-13T02:40:34+00:00
URL https://sharonlockwood.com/robots.txt
Domain IPs 191.101.228.166, 2a02:4780:39:bd20:9610:dd92:eec3:5450
Response IP 77.37.75.244
Found Yes
Hash 9b24bef5650ff7f47e8a90e7a73dd705f5c3c09bf09c4ebfe467fcc681a0ae5f
SimHash e126093723b1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://https://sharonlockwood.com/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin