Thanks to years of inflation-fueled asset-price inflation, first-time buyers can't really afford to buy.