You Don't Have To Be Baby To Cry:Joe Barry. On SMASH Records in 1961. (Caravelles had a #3 hit with this song in 1963.) #1. You don't have to be a baby to cry. All you need is for love to go wrong. You don't have to be a baby to cry. Or to lie awake the whole night long. When you leave me my golden rainbow disappears. And you leave me a broken heart that's full of tears. #2. These ain't raindrops in my eyes, why should I lie? You don't have to be a baby to cry. When you leave me my golden rainbow disappears. And you leave me a broken heart that's full of tears. #3. These ain't raindrops in my eyes, why should I lie? You don't have to be a baby to cry. A sixties smash from Kraziekhat.