Columbia, West VirginiaColumbia is an unincorporated community in Fayette County, West Virginia, United States, situated along Armstrong Creek.