Rae, really, Diana makes an excellent point. WHEN are you going? It makes all the difference.
And just to add more madness to the mix (and possibly half of it useless since I'm too new here to know your tastes and hobbies all that well)...
My favourite country to visit in Europe is Ireland. Stunningly beautiful countryside, warm people, Dublin is great fun with lots of buskers and weekend markets, the food is shockingly good, and if you don't mind the rain, it is an utterly beautiful place. Plenty of walking trips, coastal trails, and you can easily rent an apartment on the outskirts of Cork or Dublin for a week or so to ramble from.
Though, if you can afford it, Paris is quintessentially romantic and depending on what you do, it does not HAVE to be expensive. You can certainly stay in cheaper, more atmospheric places there than in London, which you could make a day visit if you wanted (it will be spectacular this year, easily one of 2012's top ten destinations).
I'll also second Istanbul. Quite spectacular. And Amsterdam for atmosphere and convenience.
Then there are all those lovely river cruises on the Danube, Rhine, Moselle... Great way to do Hungary, Budapest, French wine country etc. Do you get cabin fever, though?
Since Angie and Sona have also gone an nudged your Asia-wards, let me introduce Sri Lanka and Bhutan into the mix.
Sri Lanka is little and you can cover at least 2-3 different types of destination in 10 days. A beach town like Negombo, a bus-ride from the capital, and maybe one of the tea plantation areas up the hills or a wildlife destination. Some lovely pristine places still, the unrest is no longer a problem at this time, crazily delicious and entirely exotic (even to me, and I'm a next-door neighbour!) cuisine, and one of the most devalued currencies and beautiful crafts and textiles.
Then, Bhutan, if you like mountains. It is breathtaking. A whole other world of happiness. Very simple food, very good value. The thing to do is trek across the tiny nation --- touching Paro, Bumthang, Gangtey, Thimpu, Punakha, Tatsang monastery. Only catch --- the accommodation options are basic vs luxurious, with no middle ground. Not that basic is terrible or anything, but in case you're looking for a hotel experience...
The forgotten bit of IndoChina --- people talk of Vietnam and Cambodia (and indeed, Angkor Wat is a trip of a lifetime), but Laos is wonderful. Utterly gorgeous natural beauty, mindblowingly good and cheap food, fantastic accommodations that are also very inexpensive, extremely congenial people, and so so easy on the pocket. You won't need a thrift store, there are 'souvenirs' on every street.
Allow me to also second Singapore: You might enjoy the wetlands trail, which many people miss, but it's breathtaking. And being able to cross into Malaysia by road (though I'll recommend rail) is brilliant. For an 'expensive' city --- and it does have that reputation compared to the rest of the region --- it can be extremely good value at the lower end of the bargain too. I'll confess it is my default choice in the area. SO much to enjoy.
Thailand too is a very good choice. Bangkok is cheap, cheerfully packed with attractions, but hectic. Once you get a little further away, it is lovely. Rather than Phuket though, I'd recommend the Cha-Am/Hua Hin area. There's a lot of watersports, there are hilly vineyards in the area, national parks nearby, shopping is way, way cheaper than Bangkok or Phuket (though selections are obviously not as wide), and the weather's quite lovely in the right seasons.
I'd also have recommended China but for the language barrier. You might not want to deal with that bunch of hassles on honeymoon.
If you're thinking NZ, I'd also think Australia. An excellent reason to go to either THIS year is the solar maxima (though far northern Europe qualifies for the same reason, as do Alaska, Canada and Patagonia), because the Aurora Australis will be at its best. Lake Eyre is also currently in its fill cycle and pretty darn awesome. A hot-air balloon ride over the Uluru/Ayers Rock has just started up...
Um, right... now I've even confused myself. Erm. Getting off soapbox.