kleofia.com
robots.txt

Robots Exclusion Standard data for kleofia.com

Resource Scan

Scan Details

Site Domain kleofia.com
Base Domain kleofia.com
Scan Status Ok
Last Scan2024-09-12T21:50:55+00:00
Next Scan 2024-10-12T21:50:55+00:00

Last Scan

Scanned2024-09-12T21:50:55+00:00
URL https://kleofia.com/robots.txt
Domain IPs 104.21.75.131, 172.67.177.71, 2606:4700:3033::6815:4b83, 2606:4700:3033::ac43:b147
Response IP 104.21.75.131
Found Yes
Hash 033b22ecd71c133d89a2ca657a859c23e58dfa4472e0180d9994dc81943f1df1
SimHash 6009c98366b5

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
yandex
msnbot
msnbot-media
bingbot
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /image/

Other Records

Field Value
crawl-delay 600

Comments

  • robots.txt
  • disallow all
  • but allow only important bots
  • Directories