These are some top notch geeks. They built a setup to compute and project the trajectories of pool shots directly onto their table. It doesn’t work terribly well, but I think it is mostly a problem of low end hardware and strange setup. Why didn’t they put the webcam by the projector, pointed at the mirror? By having it in the corner they make things immensely more difficult to compute.
I think once Surface goes mainstream, innovations like this will come in a flood.