I think you have to ask yourself if, in the course of diving, you would attempt to rescue someone in trouble and, if you would, would you rather have some knowledge and practice at making it successful, both in terms of helping the victim and surviving the attempt yourself? Is there any reason to wait for some level of accomplishment? The rescue situation, if it's going to happen, won't wait for that. And maybe even more important, if it becomes a matter of you or no one, is there anything but the RD experience that's going to equip you to make the decision to act or not - or maybe to mean the only decision you can really make is more likely the right one?
(The answers aren't automatically one way or another. How many people who are reasonably good swimmers didn't survive their attempt to rescue another swimmer in trouble? If they had thought about it and had known they could have faced a situation where they could not say no, would they have taken a lifesaving course? Did not having had a lifesaving course give them the option of not attempting the rescue?)
I was going to say that, even if you felt like you wanted more diving time first, there were swimming lifesaving courses of value. Well, dang. In looking around, it seems things are not quite as they were in my youth, and in the US, organizations have largely abandoned things like the old Red Cross and YWCA Lifesaving courses in favor of longer lifeguarding courses. (Canadian YMCA continues to deliver lifesaving under the Lifesaving Society certification.) I guess the US, except for BSA, has nearly completely bailed out of basic lifesaving for swimmers.