elcodev.com
robots.txt

Robots Exclusion Standard data for elcodev.com

Resource Scan

Scan Details

Site Domain elcodev.com
Base Domain elcodev.com
Scan Status Ok
Last Scan2025-10-20T04:36:36+00:00
Next Scan 2025-10-27T04:36:36+00:00

Last Scan

Scanned2025-10-20T04:36:36+00:00
URL https://elcodev.com/robots.txt
Redirect https://www.elcodev.com/robots.txt
Redirect Domain www.elcodev.com
Redirect Base elcodev.com
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.34, 76.76.21.142
Response IP 66.33.60.67
Found Yes
Hash 1fabeaf422fbec5ebec4476afcdb9097907f25600e6897f9896c79ec38c87518
SimHash 2b2c7bf3f703

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /private/
Disallow /api/
Allow /static/
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://elcodev.com/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html
  • Sitemaps
  • Prevent crawling of admin or private areas
  • Allow crawling of assets
  • Crawl-delay to prevent server overload