Opponents say downtown plan will further marginalize the unhoused population and duplicate services city should be providing.