Concern prices in parts of Norfolk are stopping people getting on the housing ladder.