They may still have a air bubble, or you just need to adjust the brakes more.
Yeah, I agree with Pain. You said the shoes moved with the drum off, when you hit them. If you hit the brakes with the drum off, the wheel cylinders may have come out too much and let air into the system. Make sure they're adjusted up until you can feel a slight amount of drag on the drums without the brakes on, then just barely back the adjuster back off. You want the brake shoes to almost be touching the drum. It wouldn't hurt if you could feel the drum touching the shoes when you turn the drum by hand, just make sure it's not holding the drum and the drum is still turning free. Also, try to adjust the adjusters out evenly on each side, because you don't want to have just the front or just the back shoe hitting the drum. You want both to hit at the same time. If you don't adjust them out evenly, it makes it harder to bleed the brakes and get a full pedal or lever. If adjusting them up like I said doesn't get a full pedal, then you will have to bleed them.
