First of all, you will get an overwhelmingly large number of people who suggest that you get a Backplate and Wing for you BCD. While I have no experience with one, the premise is quite appealing. Remove as much as possible from in front of the diver and relocate it elsewhere. From personal experience which a Jacket BCD I find it incredibly difficult to get Into the zippered pockets and challenging to get into the Velcro pockets. This is because it is very hard, if not impossible to see you chest and stomach while diving. I like the idea of Velcro pockets on the hips very much. However, with that being said,some people just do not like BP/W's. So try the BCD in a pool (if possible) before buying.
As for the recommendations above (of which I own many) they are just too expensive for your budget. Especially the Oceanic pro plus 2.1. I own one and love it, however it's about $600. Many people will say get a brass and glass SPG and clip it to a d-ring and buy a Compass and Bottom Timer or a non-air integrated wrist computer. Personally I like a lot of information while underwater so I opt for a AI computer.
Because you are warm water diving there is no need to pay extra for cold water regs. You don't need, and on your budget, can't pay for top of the line regs. Now that doesn't mean that you will be getting a lower quality reg. Scubapro, Aqualung, Apeks, and Hog/Edge make many regs designed for different diving environments. There flagship regs are often for cold, and deep diving. While the first three listed are common names among the diving communityHog/Edge is not(Not including SB
).You can research those three companies and find many reviews you can look on their website and find all of the different regs they have. For more information about Hog/Edge contact Jim Lapenta (a member here on the Board). Or cerich, who is also a member and the owner. However, I will always state that unless you are willing to take the time to learn how to service your regs, buy the brand which your LDS services.
Octo wise, many members will tell you to get a long hose on your primary and a short one on you Octo, but bungee it around your neck using a necklace. Many people like having the same reg for their Octo but for a recreational diver there is no need to have any of that. Just get any Octo by the same company and clip it off to a d-ring on what ever BCD you choose. I use the one integrated into by BCD inflater. While I have not encountered anything wrong with it, I cannot say it is any better or worse than the normal Octo.
I would rent tanks for a little while unless you see you self just spontaneously wanting to shore dive with a buddy. However, if you are going to buy them I would recommend Aluminum 80's. You do not need the buoyancy characterizes of steel tanks.
There are many forums out there where people have asked the same questions who have based on the same budget. They recommended a BP/W package and HOG regulator package from a website called Dive Right In Scuba (DRIS). Good luck in your years to come as a scuba diver. Nothing is better than to live in Florida and be a diver!