I do all the time! I'm a vegetarian and so I'm constantly having to switch stuff up when cooking for myself. I know there's a way to thicken the milk if you need a heavy cream like consistency but I'd have to refer to one of my cookbooks.
it's very good so enjoy all you want
i use soy milk sometimes. or soy "cream". works perfectly