yourcode.com.br
robots.txt

Robots Exclusion Standard data for yourcode.com.br

Resource Scan

Scan Details

Site Domain yourcode.com.br
Base Domain yourcode.com.br
Scan Status Ok
Last Scan2025-10-05T19:27:07+00:00
Next Scan 2025-11-04T19:27:07+00:00

Last Scan

Scanned2025-10-05T19:27:07+00:00
URL https://yourcode.com.br/robots.txt
Domain IPs 104.21.11.83, 172.67.165.172, 2606:4700:3031::ac43:a5ac, 2606:4700:3037::6815:b53
Response IP 104.21.11.83
Found Yes
Hash d26ce41bbfff2df5e3f69cc3739e78d78d6dde465c51ae4e0d957ac05ac9ebe5
SimHash 2d02dfc5c6d3

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /content/
Disallow /areas/
Disallow /projetos/detalhes/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://yourcode.com.br/sitemap.xml

Comments

  • robots.txt
  • remova os diretorios
  • Sitemap autodiscover

Warnings

  • 1 invalid line.
  • `noindex` is not a known field.