brondevil.com
robots.txt

Robots Exclusion Standard data for brondevil.com

Resource Scan

Scan Details

Site Domain brondevil.com
Base Domain brondevil.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-08T11:47:17+00:00
Next Scan 2026-04-08T11:47:17+00:00

Last Successful Scan

Scanned2025-06-13T10:37:50+00:00
URL https://brondevil.com/robots.txt
Domain IPs 162.0.232.223
Response IP 162.0.232.223
Found Yes
Hash 12d998fb986cbaf39372427a67c64e2826d8955d2f933913548cda99ce73780d
SimHash afa4d852a481

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /
Allow /wp-content/
Allow /wp-includes/

*

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://brondevil.com/sitemap.xml

Comments

  • Prioritizing Homepage
  • Googlebot Optimization
  • Prevent "Blocked by robots.txt" issues
  • Improve Indexing Speed