How to Prune a Dwarf Lemon Tree

I want to have an overall tree shape. I pruned all the suckers off the trunk but since this lower branch is already woody and pretty low, should I prune it off?