He had no right to be angry with you or cold toward you whatsoever, it’s not 100% your fault that you got pregnant, two people are needed for the frick-frack. lol.
And I don’t see how you answering with your true feelings could scare him away, especially since he knew that you had them before to begin with~ Anyways, I’m glad that I could assist you in calming down at the least. :P
Does he know that you’re pregnant with his baby? (assuming it’s his based off of the way the ask is worded) Honestly I believe that your answer to his question should probably be the least of your worries.
But if I’m going to give any advice about it, I suggest that you tell him how you feel. At least that way you don’t have a load of “What-ifs?” in the back of your mind.
From my own personal past experiences, I’ve learned that you shouldn’t hide how you feel.
Hopefully that helps at least slightly helps~