That is supposed to be "on second thought". As "second" is still only one thought. If you had more than 2 thoughts about the same issue, then that is supposed to be 2nd,3rd,4th and so forth.