I was at CCV 2 years ago, and made "instant friends" with a family on our boat; grandpa, grandma, instructor buddy, mom, & 2 daughters (11 and 13 at the time, I think). One other person, my "instant buddy". That was it. The other boats had clubs. If the weather is blowing, just do the shore dive. Lots of things to do; no dive the same twice. If the weather is fine, do the boat. Our boat didn't have the center well, but it was fine. The daughters skipped a few dives early, but by the end of the week, they were on every boat, every dive. They tried a night dive, but called it. No sweat; I'm actually glad that they had the courage to call the dive; that probably means that in the future, when they try again, they'll be more comfortable.
The first boat dive is never crowded--each boat goes to a different moored dive site. On the first boat dives, you can follow the DM--or not. The dive briefing shows you the area map, and whether your pickup is where the boat is parked, or whether the boat will go to a different pickup point. If you choose to follow the DM, it's at your own depth & pace. If you just want to shoot photos at one spot, that's fine. If you want to explore around, no big deal. (Some of the reefs are a bit like mazes if you drop below the coral tops; then, you just rise 6 ft and peek above the coral tops to figure out where everyone else is--look for their bubbles). Other boat dives are on walls, so if you don't feel like going to 70 ft (or whatever), you just hang at the top of the wall. I think Calvin's does force you to 90 ft at the exit, so avoid that one, if you're concerned about maximum depth--you can hang out at the top of the wall instead of going thru the crevice.
Second boat dives are the dropoff dives--CCV wall and Newman's wall. Your depth, and your choice of walls (they advise CCV wall in the morning and Newman's in the afternoon, based on direction of the sun--but I could be confused). Swim back to the resort--don't go the wrong way! (We picked up a couple who swam the wrong way; ran out of air, and surfaced). The return wall dive can get crowded, as all the boats drop near the same area. If you're feeling antisocial, you can just find a different depth, pace, or use the opposite wall.
Pay attention (and make sure your family pays attention) during the orientation shore dive. When you return (or go out) on CCV wall, there's a "false" canyon that leads you astray (very rough shallow coral reef, rather than back to the shore entry). Learn to get back to the wreck before heading back to the shore. Likewise, pay attention to navigating from Newman's wall back to the shore entry, so that if you choose to go night diving on Newman's wall, you can navigate without the ignominy of the surface swim back to the resort because you got confused
I think your children will be fine, especially if you bring a laptop or other device & a few movies. Mind you, the accommodations are not luxurious. If you're used to 5-star hotels, this is not it. Clean & comfortable is how I would rate it.
If your wife is comfortable in the water, she'll enjoy CCV. If the seas look rough or if it's windy, just do the shore dive. You could spend every day of your vacation just doing the shore dive, and discover something new every dive; robint's video is great.
I also love the night dives. I did my first night dive at CCV, and after that, you couldn't stop me--rain, moonlight, lobster, octopus, giant shrimp (is that an oxymoron?), parrotfish in cocoons, morays, plankton--the only thing I didn't see (because of moonlight) was bioluminescence.
As the others have said, it's very well set up for diving. If my children were divers, I would not hesitate to take them to CCV.
That said, any decision you make, you'll enjoy it. I'm looking forward to being at CCV again next month.
