I know most of my 12 volt starters actually say 12V somewhere on the body. You can tell by the starter model # but I'm not knowledgeable enough to say how. I can tell you as long as you don't stay on it for more than 3 or 4 seconds, you'll be fine using the 6volt starter with a 12 volt battery.
JBJ