Log In Sign Up

weedidentifier.org
robots.txt

Robots Exclusion Standard data for weedidentifier.org

Resource Scan

Scan Details

Site Domain weedidentifier.org
Base Domain weedidentifier.org
Scan Status Ok
Last Scan2025-09-29T16:07:07+00:00
Next Scan 2025-10-29T16:07:07+00:00

Last Scan

Scanned2025-09-29T16:07:07+00:00
URL https://weedidentifier.org/robots.txt
Domain IPs 34.111.179.208
Response IP 34.111.179.208
Found Yes
Hash 6e6c30173d74b58aea4fe7d2c55791e03e488fc7be4f77f7983ce0f446b75943
SimHash 4f15ce12ed07

Groups

*

Rule Path
Allow /
Allow /library/
Allow /about
Allow /contact
Disallow /admin/
Disallow /api/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://weedidentifier.org/sitemap.xml
Back to top

Comments

  • Sitemap
  • Allow search engines to crawl all pages
  • Disallow admin/private areas (if any exist in future)
  • Crawl delay
Back to top