I began diving in quarries but was quite happy when I moved to SoCal in the 60s and could dive where I really needed to as a kelp forest ecologist. As long as you enjoy and benefit from where you dive, that is fine. I see no need to justify my diving to anyone... but I find non-divers are often quite curious and I'm happy to answer their questions.