Well I'm heading towards my 3rd year of dental school, and am actually posting here as a study break from studying for part 1 of the national boards. To answer the original question, properly done fillings and crowns shouldn't be an issue because there shouldn't be any air spaces or voids within them. Voids tend to wreak havoc in dentistry in regards to micro-leakage and decay.
In the case of a crown, the tooth should be prepped and the crown designed in such a way that the tooth structure and crown are separately only be an ultra-thin layer of crown cement. Any kind of gap or void at the margin of the edge of the crown and the tooth greater than about 50 microns is considered clinically unacceptable and prone to microleakage.
As for temporaries - they are exactly that. They often aren't fabricated or placed to the same standards as the final crown as they're going to be removed in a short time when the final crown comes back from the lab. There are also several different ways to make them, one of which is acrylic, which can have some minor voids itself if not mixed and molded properly. That being said, a temporary can be made very well and last far longer than it's designed to. In school clinics, especially ones serving lower socio-economic classes, patients have a tendency to not return for follow-up appointments whenever they aren't suffering from an immediate need or problem. They therefore often won't even return to have the temporary swapped out with the final crown. Some dentists will therefore make the temporary a significantly different color shade just to remind the patient of the need to return, instead of risking further damage later once the temporary starts to break down. So yes, a well-made temporary could likely survive diving without issues, but I'd never recommend it.
To Dmoore and the others who expressed their hatred of dentists - I'm sorry about your experiences. At the same time, it's the plight of people such as yourself that inspire those of us just entering the field to remember the fundamental reasons for offering care and the real measure of success, which is not judged just under a microscope or a set of loupes, but by the betterment of the patient's life and well-being.