Fannie Pitts Howard was born in 1884 in Hill Country, Texas. She worked as the dormitory directory, also known as the "dorm mother," of Jackson-Shaver Hall during the 1940s and 50s. Howard died in 1976 at the age of 91.

Andrew Jackson Hall was built in 1939 by the Governmental Works Progressive Administration (WPA). Andrew Jackson Hall was named for Sam Houston's good friend and seventh President of the United States, Andrew Jackson. Jackson Hall was the first male dormitory built on the SHSTC campus.

In 1946, an addition was built on the west side of Jackson Hall. The subsequent Charles Shaver Hall was named after Charles N. Shaver, alumna and sixth president of the Sam Houston State University (SHSU). As newer dormitories were built, Jackson-Shaver Hall was used for visiting delegations and groups from other cities. In 1974-1977, the Houston Oilers used Jackson-Shaver Hall for their summer practice quarters.

In the spring of 1975, Jackson-Shaver was closed for renovations to enlarge the dorm rooms for the Houston Oilers' summer programs. The renovation turned some rooms into private rooms with private bathrooms. After a few years, the Houston Oilers found another location for their summer practice, leaving these larger rooms for future students.