This talk covered the capabilities and features next generation apps require – and what it means to take advantage of the new 4th Generation Intel(R) Core(TM) processors.

Key Core Features;

  • Intuitive – Perceptual computing
  • Fluid – Iris high performance graphics
  • Portable – Easier to hold thanks to lower power requirements and better thermals
  • Faster – Integer performance for more physics
  • Smoother – Lower latency touch subsystem with new processors and Windows 8.1
  • Touch – Optimised for touch
  • Display – WIDI for sharing on big screens

Highlights of the overview on next generation apps include;


  • Give feedback of action triggered
  • Provide a way to undo the action
  • Actions to be commutative (any order)
  • Physical ‘manipulation’ should be obvious and reversible (move, rotate, resize etc)
  • Actions should be repeatable and reliable (don’t rely on gestures which the sensor cannot repeat)
  • Reveal the gestures and their function (with hints)


  • NUI is not a fixed toolkit like a GUI
  • Don’t just mimic GUI or web apps
  • NUI is still abstract, it’s not real world
  • NUI should seem an extension of the body
  • NUI can leverage previously learned skills
  • Involves game aspects
    • enjoyable interaction
    • a path to skilled usage
    • but NOT challenge
  • Direct manipulation
  • Gaze tracking with speech
  • Aim for skilled and fluid actions


  • Touch has ‘action’ but no tracking
  • 3D Gesture has tracking but no ‘action’
  • Near touch and stylus with hover/proximity provide the best of both worlds
  • Fingers, hands and arms obscuring the view of the screen
  • You can drag objects beyond a physical constraint
  • Right click is no good for touch/pen (can be replaced with a dwell if critical)
  • DON’T generalise between devices and sensors