The proposal pits advocates of affordable housing against residents worried about congestion and new construction towering over side streets.