is it cold where you are

Yes

It's 4°C(Google says that's 39°F).It's also been quite windy and it's been raining for days.

It is cold here!! It's 2°C atm.

-4°C

38 f (3 Celsius)

Depends what is cold? it is 1°C right now. Relatively warm what it used to be here during January. I personally think even - 10°C still feels pretty warm if moisture % is low. Once weather become colder than - 15°C , weather start feeling cold. Once it become - 30°C I don't want to go outside anymore lol.