I've stayed at Bienville House in the French Quarter several times and enjoyed it, it seemed to be in walking distance of most things -
http://www.bienvillehouse.com/
One restaurant we enjoyed was this one -
http://www.palacecafe.com/
I also enjoyed House of Blues and Cafe Du Monde
www.cafedumonde.com
We took a voodoo tour from this company that was entertaining and there are many others available as well -
http://www.neworleanstours.net/
The tour included a lot of fascinating history of the area as well as the hauntings and voodoo.
I also went on a great paddleboat cruise back when Texas went to the Sugar Bowl -
http://www.neworleanspaddlewheels.co...eolequeen.html
A friend of mine got engaged in the Park -
http://www.neworleanscitypark.com/
The Audubon Park and Anne Rice's house on the St Charles Streetcar line is also nice to see.
http://www.regionaltransit.org/
And you can go on a swamp tour at the Audubon Zoo -
http://www.auduboninstitute.org/
There's lots of fun shopping too, depending on what you might be looking for. Magazine Street has some unique finds.
The French Market is fun -
http://www.frenchmarket.org/
Have a fun honeymoon!