At the start of the dive, you will have greater buoyancy as a result of trapped air and fully expanded neoprene in your wetsuit. You'll also be carrying more ballast in the form of compressed gas in your cylinder. If you are properly weighted, there is a good chance you will have to completely purge your BCD of all gas to descend easily.
Once you descend, water forces out gas spaces in padding and pockets where your suit is loose fitting. Additionally, your suit will compress, resulting in a loss of buoyancy which will need to be compensated for or you will find yourself significantly negative. You can compensate for this to a point by altering your breathing pattern, but that's not ideal because it will force you into a pattern which does not effectively exchange O2 for CO2.
There really is no such thing as neutral buoyancy for divers, as there is always a change as you breathe. Even without the change breathing causes, you can never be perfectly neutral. So, neutral buoyancy is more a matter of balancing positive and negative. Half your breath cycle you will be positive, the other half will be negative.
If you are finding it easier to descend than to ascend using just breath control, you are likely shifted more towards the negative and should compensate by adding some gas to the BCD.
The key to buoyancy control is anticipation and action. Rather than waiting until you are at the desired depth to compensate, you should be adding or subtracting gas to the BCD as you descend or ascend to maintain a controlled rate of ascent or descent. If your descent requires you to clear your ears multiple time, that same pressure is compressing other air spaces and needs to be compensated for.
Every ascent will require you to dump gas from your BCD as the ambient pressure decreases and the volume of gas in your BCD and other spaces increases. Every descent will require you to add gas to your BCD as those same spaces are compressed.
The amount of compensation required will depend primarily on the thickness of your exposure protection, but being over weighted will also have an impact. If you are 8 pound negative at the start of the dive, you will need 8 pounds of buoyancy in your BCD to be 'neutral' at the surface. If you descend to 33fsw without adding gas to the BCD, the 8 pounds of buoyancy you had in your BCD at the surface will be reduced to 4 pounds and you will now be 4 pounds negative. This is ignoring all other dynamic sources of buoyancy and ballast, which would cause an even greater shift.
You can use your lung volume to compensate, but that should be a very short term fix as you are tweaking the gas in your BCD.