Actually, both “on the one hand” and “on one hand” are considered correct, but “on the one hand” is preferred by many dictionaries (and most speakers) while “on one hand” is listed as an alternative form (and some speakers consider it unnatural):
However, intuitively, the first “the” seems illogical, because you are referring to one of your hands without specifying which one. You wouldn’t say, for example,
unless you were waving one of your hands while saying so, and you wanted to underline the fact that this had been the hand with a glove.
I’ve read an explanation that the first “the” originates really in gesticulation using one hand while saying the phrase (i.e. you would be looking at your hand and saying “on the one hand …”). Whether this is really true, we may never know.