laurie -
The whole phrase is "It is cold enough to freeze the balls off a brass monkey".
I didn't think anyone in the south would know the phrase as it doesn't get cold enough to freeze anything down there much less brass! But I guess it's all relative.