Jim boarded at the College from 1941 to 1943. His father had also attended, Leslie James (1913-1915). Jim played in the 1^st XVIII football team for two years, receiving multiple school football caps and colours. He was also in the 1^st VIII rowing crew and received rowing cap and colours. In 1943 he was the recipient of the Alexander Coto and John Coto Memorial Prize and reached the rank of Sargeant Major in the Cadets.

Following school, Jim enlisted in the Royal Australian Navy and served as an Able Seaman until 1946, serving in the Pacific during World War II.

After the war, Jim married Nancy and they had two children, Anne and Bill (OGC 1965). The family became successful farmers Longford, Darriman and Carlsruhe. Jim eventually moved back to his farm in Carlsruhe. He retired at 90 and moved to Kyneton.