Columbia House, known for penny-taped ads and 16 million members at its peak, will shut down this month, marking a nostalgic end to its music era.