Phuket is a fairly big island. If you look, you can find surprisingly quiet areas. Do a few days on Lanta diving Hin Daeng/Mouang as day trips. Perhaps Ko Haa and Phi Phi. Then a liveaboard to Similans/Richelieu Rock from Phuket. Daytrips to King Cruiser/Shark Point from Phuket can be surprisingly good inme. You’re there in a good time.