Most people are somewhere around close to neutral just by themselves. If you are that, and about 5# of your ballast is offsetting an AL80, then that means you have 30-ish pounds of weight to compensate for buoyancy from your drysuit.
And that means that if you had a catastrophic failure of your drysuit (say, a user-changeable neck seal just happened to pop off), you could be on the bottom and 30-ish pounds negative. If your AL80 is full, add another 6 pounds or so to the amount you'd be negative. In your situation, I would probably want a wing with more than 30 # of lift. But, if you're willing to just ditch your 20# weight belt, then a catastrophic drysuit blowout would just mean ditching the belt and a 30 # wing is probably more than adequate. But, if you ever decide to make a change and attach all that weight to your rig, where it's not ditchable, then a 30# wing isn't nearly enough. You'd probably need a 40# wing (at least) to float a rig that has 36 - 38# of weight attached to it, in the event you needed to take it off in the water.