...
If you're really committed to seeing the best Atlanta has to offer, however, it's probably fair to say that a step up in the transportation budget is called for. A $15-$20 cab ride can get you out to NW Atlanta, which has become a haven for foodies and mixologists in recent years, as well as a preferred spot for boutique shops, galleries, etc. A similar distance north on Peachtree will also bring you some of Atlanta's best restaurants and museums. Instead of a cab, you might also make friends with a local (see below) and bribe them their transportation services with a dinner date.
Atlanta's downtown and midtown districts have good Zipcar coverage, if you have a membership (or are willing to start one).
...