davidcreator.com
robots.txt

Robots Exclusion Standard data for davidcreator.com

Resource Scan

Scan Details

Site Domain davidcreator.com
Base Domain davidcreator.com
Scan Status Ok
Last Scan2025-09-05T21:39:57+00:00
Next Scan 2025-09-12T21:39:57+00:00

Last Scan

Scanned2025-09-05T21:39:57+00:00
URL https://davidcreator.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.112.1
Found Yes
Hash 0ddab6f8fa933d3d859c50173630ca31e977fdab9961811e1685f672fe6cb589
SimHash ac3fd807afc6

Groups

googlebot

Rule Path
Allow

bingbot

Rule Path
Allow

yahoo! slurp

Rule Path
Allow

yandexbot

Rule Path
Allow

baiduspider

Rule Path
Allow

duckduckbot

Rule Path
Allow

teoma

Rule Path
Allow

aolbot

Rule Path
Allow

*

Rule Path Comment
Disallow Para todos os outros bots, por padrão, não é permitido rastrear
Allow / Permitir que todos os bots acessem todas as páginas do site

Comments

  • Diretivas adicionais, se necessário
  • Sitemap

Warnings

  • `https` is not a known field.