Log In Sign Up

encremadas.com
robots.txt

Robots Exclusion Standard data for encremadas.com

Resource Scan

Scan Details

Site Domain encremadas.com
Base Domain encremadas.com
Scan Status Ok
Last Scan2025-10-27T23:04:41+00:00
Next Scan 2025-11-26T23:04:41+00:00

Last Scan

Scanned2025-10-27T23:04:41+00:00
URL https://encremadas.com/robots.txt
Domain IPs 162.241.253.138
Response IP 162.241.253.138
Found Yes
Hash c1cdc3236f4bf786e1351c3699a21a451493017191debe30cd61e5b64a8e8957
SimHash c01442125e18

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

wget

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

feed

Rule Path
Disallow /

empty user agent string

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

firefox version 10 and lower - various robots

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

unknown robot identified by bot\*

Rule Path
Disallow /

unknown robot identified by \*bot

Rule Path
Disallow /

unknown robot (identified by hit on robots.txt)

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Permitir solo a Googlebot y Googlebot-Image
  • Bloquear explícitamente los siguientes bots problemáticos
  • Bloqueo general a todo lo demás
Back to top