Design for usability and design for experince

There is growing consensus among the interaction design practitioners that the concern of usability are not sufficient for acceptability of the interaction designs. Newer paradigms of joy, surprise, appeal have to be incorporated along with efficiency, ease of use and memorability etc.
This in a way has also been led due to the increase in sophistication of technology and it's ubiquity. The technology as an immersive experience instead of an outstanding tag in the daily life needs to be soon accommodate in the interaction design process.
The popularity of the user centred design process has promises to lead such a movement. But the tools at the hand of designers are still very few to aid the design thinking by the designers. The problem becomes more acute when we accommodate the separability of the users and the designers. When cultural, societal and semantic differences exist between the designer and the user, deciding for the experience of the user becomes more and more black box guess game. The user data collection methods so far in practice and the evaluation processes popularly used are incapable of rendering the data relevant to the users that could give the starting point for the designer in the conceptualisation process.
New methods such as Mind Tape has been (proceedings HCI 2007) suggested to this end . There is more work needed to be done on this front.