You're kind of on the fence as far as sizing. You could probably pull either off. If it was me I'd probably try the large. I'm 5'11 155 and I wear a size large in Holden jackets. I wear a hoodie under it and still have good range of motion. Holden does a good job of cut and design so the jacket moves with you, not against you.
Hope this helps.