Merilyn Alsop, the wife of J. A. from 1957 to 1972, was born on October 22, 1934 in Washington, District of Columbia, USA at Freedmen's Hospital because in her hometown women of color were not allowed to bear children in hospitals in Annapolis, Maryland, USA. J. A. and Merilyn had three children: Scotti (daughter) born in 1958, Dominique (daughter) born in 1959, and James Allen, Jr. (son) born in 1961. Merilyn died of natural causes in Annapolis, Mayland, USA on April 26, 2010.