The balun is probably acting more like a loading coil than it is as a
ballun.

If you can't increase the length of the wire, try inserting a coil of
several turns into the wire on the feed end. That would very likely bring 80
and 160 back for you. You might still need to remove the coil for the higher
bands, but maybe not.