As prices paid for the average single-family property hit record highs, big investors are taking a pass.