I think you would miss out if you didn't spend some time in Port Douglas...it is a FANTASTIC place to visit and a GREAT base of operations to explore the incredible surrounding areas.
We researched far north Queensland at length before booking our trip a few years ago. We were intrigued because this is the spot where three World Heritage areas meet...The Great Barrier Reef, The Daintree Rainforest, and The Outback all converge in this area. Since we were undertaking quite a journey to get there, we didn't want to miss any of it.
We started out in Cairns, where we spent a couple of days before undertaking a three day liveaboard experience aboard the Spirit of Freedom. We took advantage of the opportunity to visit a couple of the attractions in the area before our dive adventure. Cairns was nice, but it had more of a city feel. We enjoyed the things we did, but then we were ready to move along. (Important to note...our focus is on nature and diving - not fine dining and partying, so our perspective may be different) When our dive trip concluded it was time to move along to Port Douglas, which became our base of operations for the next ten days.
We absolutely fell in love with Port. It is a friendly village where you can stroll around and feel perfectly safe and happy. Four Mile Beach is one of the loveliest beaches in the world, but watch out for the stinging jellies! We also enjoyed Anzac Park and the Marina Mirage. There are plenty of shops to explore. The best of all is the ice cream shop! We made a stop at "Wicked" for ice cream part of our daily routine.
While in Port, we did our diving with Calypso Charters
Port Douglas Cruises,Great Barrier Reef Tours,Snorkel Dive Trips - not one of the charters mentioned in a previous post. They didn't tie up to any pontoons, but went directly to dive sites and offered us three dives per day. I would recommend them highly. We thoroughly enjoyed the diving out of Port Douglas.
During our non-dive days we took advantage of the opportunity to visit the other World Heritage areas. We had a private tour with David Armbrust
Ecotourism - Port Douglas North Queensland Australia which turned out to be the highlight of our entire trip! It was absolutely phenomenal. David took us up to Mt. Lewis and even over to the other side to sample a bit of the outback. But the best part was the stroll through "Thylogale", his personal property, which has been cultivated to attract and support amazing flora and fauna. David is like a modern day "Dr. Doolittle"...he can talk to the animals...and they respond! We had such a wonderful time and interacting with him reinforced our love of nature even more.
We also booked another tour with a different company, although less personal and more touristy, up to the Daintree Rainforest. On this tour we crossed the Daintree River by ferry and explored even farther north. We saw some beautiful sights along the way and had a great day.
These are experiences we would not have had the opportunity to try had we been based in Cairns for our vacation. At the very least, I would suggest that you split your time between the two locations. There is so much to enjoy in far north Queensland!