I have a 31/32 waist with jeans that fit...
I have a 31/32 waist with jeans that fit comfortably, but I'm told maybe I should get a med. so they're a bit loose/comfy. I don't want them to be too loose though- I'm also short as hell and have a 28" inseam. Should I go with the smalls?
Yes, you could go with smalls on these pants. Those should do you just fine.