The most important limit is personal. If you do not feel comfortable going below 60ft, don't do it. Uncomfortable divers are unsafe divers. The truth is, there is no magical distinction at 60 ft, 100ft, or even 130ft. The 60ft limit was chosen as a function of NDLs and the time to use an AL80. 100ft and 130ft are arbitrary. The training that you would qualify for is not really useful (PADI deep diver or AOW). Experience is what you need.
The environment is also a consideration. While many divers are not mature enough to deal with narcosis at 100ft, if you asked this question, you probably are. If you are going on a dive trip in the caribbean, it will probably be supervised and relatively safe for you to go deeper. If you want to increase your limits, this is the place to do it. However, if you plan on diving a NJ or NC wreck, things can get rather hardcore. I wouldn't advise doing those type of dives without more experience.
BTW, how many dives do you have?
brandon