Sounds like the solenoid is bad, stuck in the on position. Find it and smack it with a screw driver or hammer and see if it will stop turning over when you have the jumper cables hooked up. If it does, then replace it.
As for not starting, you can cross that bridge once you fix the first problem.