I think to answer the question you first have to answer under what circumstances you will be needing to ditch weights. and then decide if you need it or not.
Situations I can think of:
1. you are unconsious and your buddy would like to keep you on the surface. in this one if he knows where your weight pockets are, he can dump them.
2. failed BC, and leg cramp, and you forgot to change tanks and run out of air, and it is a wednesday, and your buddy is more than 20 ft away.
3. I know there is more but I need more coffee to remember
Situations I can think of:
1. you are unconsious and your buddy would like to keep you on the surface. in this one if he knows where your weight pockets are, he can dump them.
2. failed BC, and leg cramp, and you forgot to change tanks and run out of air, and it is a wednesday, and your buddy is more than 20 ft away.
3. I know there is more but I need more coffee to remember