I used to dive L Jets. I took a class and my instructor mentioned that I should try out the XL's and see how I liked them. He thought they would give me a bit more power, so I wouldn't have to "work my butt off" to keep up with others. So I decided to give the XL's a try. I hated them at first, but now I love them. However, I don't really notice much difference in my power or ability to swim....I do notice that I feel like I have a more stable platform for hovering.
When I started diving doubles, my first two dives were with buddies who always take their time and I never have problems keeping up with. Of course, on these dives, I felt like I was working so hard and couldn't possible keep up. Turns out, when you change gear (drysuit was the same as well), it takes a few dives to get to know it and for it to start to feel natural. I now no longer feel like it's stressing me to "keep up" with my buddies.
It's likely changing from singles to doubles that you're noticing....and changing from L's to XL's probably won't make much difference until you figure out how to swim efficiently with your doubles.
FWIW, I wear a womens size 7 shoe....the XL Jets have a bigger foot pocket than the L Jets, but not unmanageable, especially if you have a slightly bigger foot than mine. If your drysuit has turbosoles, I recommend thick socks (I wear Thinsulate socks)....if not, I've found that a pair of Chucks work nicely with the foot pocket.