reACT to this!!

The jargon: reacTIVision is an open source, cross-platform computer vision framework for the fast and robust tracking of fiducial markers attached onto physical objects, as well as for multi-touch finger tracking. Read more here.

Moving Brands has used this technique for London College of Fashion degree shows for the last 3 year with gorgeous results. I love flawless interactive design :)