There are many ways to carry and utilize more than a single tank (as others have alluded to). There are stage bottles (tanks that are clipped off of your harness d-rings using bolt snaps), there are side mounts and the more common doubles.
Within doubles, there are the two independant tanks and those connected via a manifold that has an isolator valve. The advantage of the second set-up is that you can dive with the tanks connected. This uses each tank equally (keeping you in trim). The valve allows you to colse off one side if the need arises (such as major airloss coming from one set of regs. There are a few downsides: cost and converting a tank back to a singles set is more work. There is also the risk that you might accidentally close the islolator valve when you did not mean to. I don't think any of these issues are a huge deal.
For SPG, my rule is simple: I have a pressure gauge for every tank I take with me.
Most doubles sets I have seen use the manifold. So the tanks are joined both by the manifold and by some doubles bands. The doubles band then mounts to the backplate. The backplate is attached to the diver by a harness. And the air cell or wing (the flaoty part of the bc) attaches to the backplate.
It sounds way more complicated than it is. But creating a set of doubles is pretty spendy. Lets assume you already are using a back plate and wing as your BC and you currently have only one reg set and no suitable tank. No need to replace the harness, plate or reg or tank. (Note: IMHO, tanks should be of matched brand/model and size)
So, about $150 for a nice set of bands. Around $200 for a manifold. Another $250 to $300 each for two steel tanks. So at just less than $1k you have your set of doubles.
But wait, another $300 give or take for a nice doubles wing. Then, ideally, you add another reg first/second. Lets say you go about $450 for that. Oops, and that extra spg for about $80. At this point, many divers if they want to also have a singles set will buy another plate and harness.) These are all new prices.
OTOH, over time, many divers (most?) accumulate gear. Many already have that second tank, that second reg set and that second spg. For them, the cost is much less. And there is always the used route as well....