Jim Charbonneau was born in Fall River, Massachusetts. His childhood home was in Bristol, Rhode Island. After graduating from high school, he attended New Hampshire College (known as Southern New Hampshire University) in Manchester, New Hampshire. He enlisted in the United States Navy in February 1977. After completing the USN Nuclear Engineering Program in December 1979, he served aboard the submarines USS Lafayette and USS Robert E. Lee from December 1979 to December 1983, completing five deterrent patrols. Jim attended the Instructor Qualification School in Bremerton, Washington, from January through February 1984. He completed his naval career as an instructor, choosing to leave the Navy