Founded in 1950 and moved to its current Main Street location in 1998, the Columbia Museum of Art remains a steadying presence, but one that doesn’t want for ambition.

Its upstairs galleries draw from a renowned, well-rounded permanent collection of contemporary and modern pieces, while rotating downstairs exhibitions have recently featured the likes of Andy Warhol and Georgia O’Keeffe and thoughtful, boundary-pushing displays like last year’s REMIX, which focused on African-American works inverting the conventions of Western art…