Thanks for the replies guys. I think I'm leaning toward putting pockets at the waist of my harness. If you're using a weight belt, how do you arrange it with the harness? Does it sit above or below the waist of your harness?
XSScuba weight pockets are $10/ea. They aren't exactly quick-release, just basic velcro, but weight should be easy enough to ditch if you need to. Slide on any 2" webbing: tank strap, waist strap, shoulder straps. They should hold a couple of 5lb weights each I think.