what is your goal? if you think you could stand to lose some fat then do it...if not then bulk. just do which ever one will make you feel better about yourself.
i was 230lbs of fat and slimmed down to 175lbs and still had fat. i looked skinny but i also looked like i didnt have any muscle....i was skinny fat

...now im 195lbs around 10% bodyfat and look a million times better then when i was 175lbs. so dont worry about the scale, just focus on the weight you are lifting and your body measurements to track your progress.
if your just starting off lifting and chaning your diet as well you will lose weight and gain muscle since you will see beginner gains. i would focus on bulking now since summer is on the way out, your body fat isnt that high, and since your starting new you will see gains in muscle and fatloss.