The long-planned development of 123 affordable apartments for seniors would have gone up on city-owned land in Lower Manhattan.