Avoid!!!
This is the worst hotel I've ever stayed at. We had reserved 5 nights, left after the first night. We made our decision after entering the room. The carpet had multiple stains, so did the covers on the beds. We found loose nails by one of the beds, stuff behind the nightstand and, most disturbing, something behind one of the beds that looked either like a used condom or a rubber glove. I did not dare to pull it to find what it was. I've attached a picture, you can see it for yourself. The cabinet door with the old tube TV was broken, we had to prop it with a table in order to watch the TV. All that could have been tolerable, if it wasn't for the entire hotel feeling like it hadn't been maintained for years: the walls were peeling off, the carpet was stained, everything felt unclean. Some people would say, well, it has style... It all looked old, not classic, forgotten, not vintage, abandoned, not stylish.
We found another hotel only a few blocks away (on W 31st and Broadway) where everything was absolutely clean, the staff was helpful and positive and where we felt incredibly comfortable and paid less than what we paid for the room at the Pennsylvania Hotel. So, the good location of the Pennsylvania Hotel shouldn't be a reason to book it.
The good thing about it, though, was that the staff person at the reception desk was very helpful when we said we would leave early. He was the only helpful person at the desk, though.