desimoja.com
robots.txt

Robots Exclusion Standard data for desimoja.com

Resource Scan

Scan Details

Site Domain desimoja.com
Base Domain desimoja.com
Scan Status Ok
Last Scan2026-02-13T22:19:49+00:00
Next Scan 2026-03-15T22:19:49+00:00

Last Scan

Scanned2026-02-13T22:19:49+00:00
URL https://desimoja.com/robots.txt
Domain IPs 104.21.40.212, 172.67.188.97, 2606:4700:3030::ac43:bc61, 2606:4700:3036::6815:28d4
Response IP 172.67.188.97
Found Yes
Hash e1af6b5ceeaaa3d7b7c1c527253d03c45ddcb7c26b9e3f77f8ad3cfac6bce1b1
SimHash b640dad3ad20

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /storage/
Disallow /report
Disallow /*?s=
Disallow /search?
Allow /css/
Allow /js/

Other Records

Field Value
sitemap http://127.0.0.1:8000/sitemap_index.xml

Comments

  • robots.txt for WordPress Sync Laravel Application
  • Generated on November 12, 2025
  • Block admin and private areas
  • Block search result pages to avoid duplicate content
  • Allow CSS and JS files for proper rendering
  • Sitemap location