reACT to this!!
The jargon: reacTIVision is an open source, cross-platform computer vision framework for the fast and robust tracking of fiducial markers attached onto physical objects, as well as for multi-touch finger tracking. Read more here.
Moving Brands has used this technique for London College of Fashion degree shows for the last 3 year with gorgeous results. I love flawless interactive design :)