“When the agreed-upon use is changed or deviated from, and that change impacts the neighborhood negatively, the city and greater community need to stand up and hold those in charge accountable.”