c.1200, from Old English on life "in living." The fuller form on live was still current 17c. Alive and kicking "alert, vigorous," attested from 1859; "The allusion is to a child in the womb after quickening" [Farmer]. Used emphatically, especially with man; e.g.:
Thus abstracted as an expletive, man alive! (1845).