Log In Sign Up

hablemosdecriptos.com
robots.txt

Robots Exclusion Standard data for hablemosdecriptos.com

Resource Scan

Scan Details

Site Domain hablemosdecriptos.com
Base Domain hablemosdecriptos.com
Scan Status Ok
Last Scan2025-12-20T23:45:14+00:00
Next Scan 2025-12-27T23:45:14+00:00

Last Scan

Scanned2025-12-20T23:45:14+00:00
URL https://hablemosdecriptos.com/robots.txt
Domain IPs 70.35.195.87
Response IP 70.35.195.87
Found Yes
Hash df27b2f2c8b32262de09f9279e8b012583591cad822cefa2288b9134a59745fa
SimHash a314451eeb60

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://hablemosdecriptos.com/sitemap.xml
Back to top

Comments

  • Directivas para el bot de Bing para que deje un
  • delay (especificado en segundos) entre peticiones.
  • También se especifica el intervalo de horas en las
  • que se le permite hacer el crawl de la web
  • Bloqueamos Alexa y archive.org
  • Sitemap
Back to top

Warnings

  • `visit-time` is not a known field.
Back to top