03 rancher es starter troubles

I'm having trouble with my 03 rancher es starter. I turn the key on, push the starter button and all I hear is a "click" from the selenoid. I have a brand new battery and am trying to decide if it might be the selenoid, starter button or the starter. Any help will be greatly appreciated!