Residents want to restore districts to something like they were, but that conflicts with new affordable housing laws.