‘It doesn’t sound like who he is’: Family of man jailed over baby’s death said they saw no signs of abuse