Almost Perfect
I would have given the Madison a 5 star rating, but for a few little details. First off, let me say that the staff at Madison are top notch! I have never experienced such friendly and helpful people anywhere else, and I travel quite a bit. The hotel is absolutely gorgeous, the rooms are clean, cozy, and well appointed, the bathrooms are large, the hallways and elevators clean (you'd be surprised how many "nice" hotels neglect the common areas), the rooftop views are fantastic, the hotel is quiet, you are within walking distance to all the fun stuff, and room service is fairly quick to bring up their scrumptious food. 
All that being said, there were some negatives. We got two room keys, one of which never worked, and the other had to be reactivated several times. Not really a big deal, just an annoyance to have to go back down to the lobby to have it fixed. The free breakfast offered was severely lacking. The fruit was nice, but the bread, namely the muffins, were so dry they had to have been several days beyond edibility. After experiencing their wonderful food through room service, I expected more. The parking fees are outrageous! Thankfully we got a spot at one of the meters out front, and didn't have to worry about parking. 
All in all, I think the Madison has earned it's 4 star rating, and I'd be glad to stay there again.