devicode.com
robots.txt

Robots Exclusion Standard data for devicode.com

Resource Scan

Scan Details

Site Domain devicode.com
Base Domain devicode.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-15T06:21:09+00:00
Next Scan 2025-10-29T06:21:09+00:00

Last Successful Scan

Scanned2025-09-29T18:52:20+00:00
URL https://www.devicode.com/robots.txt
Domain IPs 70.32.23.78
Response IP 70.32.23.78
Found Yes
Hash 277fe41d61a28e0d4f9a58ed819ee26ba0ed384d965a794a2dda934758cb8fb0
SimHash 2646dfd1e965

Groups

*

Rule Path
Allow /
Allow /css/
Allow /js/
Allow /images/
Allow /assets/

Other Records

Field Value
sitemap https://devicode.com/sitemap.xml

Comments

  • Allow access to CSS, JS, and images for better crawling
  • Sitemap location
  • Crawl delay (optional - adjust if needed)
  • Crawl-delay: 1