Log In Sign Up

ethiotools.com.et
robots.txt

Robots Exclusion Standard data for ethiotools.com.et

Resource Scan

Scan Details

Site Domain ethiotools.com.et
Base Domain ethiotools.com.et
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-10T05:00:42+00:00
Next Scan 2026-01-09T05:00:42+00:00

Last Successful Scan

Scanned2025-09-11T13:56:54+00:00
URL https://ethiotools.com.et/robots.txt
Domain IPs 91.204.209.4
Response IP 91.204.209.4
Found Yes
Hash 6599c76d0559f572c16948159ab0b146dd4d24e93050a539795c55221b392eac
SimHash 6505fbf325d1

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /
Disallow /admin/
Disallow /includes/
Disallow /config/
Disallow /backup/
Allow /tools/
Allow /games/
Allow /images/
Allow /css/
Allow /js/
Allow /tools/*.php
Allow /games/*.php
Disallow /*.log
Disallow /*.sql
Disallow /*.bak
Disallow /*.tmp
Disallow /*.cache
Back to top

Other Records

Field Value
sitemap https://ethiotools.com.et/sitemap.xml
Back to top

Comments

  • Sitemap
  • Crawl-delay for respectful crawling
  • Allow all major search engines
  • Disallow admin areas (if any)
  • Allow important directories
  • Specific rules for tools
  • Block access to sensitive files
Back to top