DA A .... above 25000 feet, IF one of the two pilots leaves the cockpit, then the remaining pilot must wear a mask while he's alone up there. (Above 41000 one pilot would have to wear it all the time, but that's a moot point since the aircraft isn't certified to fly above 41000 anyway.)
As for O2 toxicity ... even at sea-level, breathing pure O2 would only give you a ppO2 of 1.0 ... toxicity isn't really a problem till you reach 1.4-1.6 ppO2 (as in breathing pressurized air/O2 at depth.)
It could be just because I don't smoke and have good lungs (between running and diving, they get lots of exercise), but I've never noticed any night vision improvement from sucking on O2... and about 90% of my flying is done at night.