animalesdefamilia.com
robots.txt

Robots Exclusion Standard data for animalesdefamilia.com

Resource Scan

Scan Details

Site Domain animalesdefamilia.com
Base Domain animalesdefamilia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-08-15T05:33:08+00:00
Next Scan 2024-10-14T05:33:08+00:00

Last Successful Scan

Scanned2024-06-17T05:32:16+00:00
URL http://www.animalesdefamilia.com/robots.txt
Domain IPs 31.214.178.90
Response IP 31.214.178.90
Found Yes
Hash c0da3f06754341fc1b4dec48eabe801f0b36496260b760452058aa2a0afed975
SimHash 891889a2fa81

Groups

*

Rule Path
Disallow /offline/
Disallow /offline
Disallow /offline.html
Disallow /archivos/
Disallow /pwa/
Allow /

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot@gmail.com)

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

Warnings

  • 2 invalid lines.