The city is named after U.S. President William Henry Harrison.

Harrison is near the junction of US 127 and M-61. US 127 actually bypasses the city on the east, though a business route serves the downtown area. Clare is 14 miles south on US 127, while Grayling is 40 miles to the north. Harrison is bordered along its eastern side by Budd Lake.

Harrison was originally founded as a lumber town, with sawmills located on the shores of Budd Lake. One of the lumber companies donated the land which is now Wilson State Park.