Live rectangle tracking and image transformation (Video)

It's time for a new video from the projector group! If you've read our previous posts, you know that we intend to use colored rectangles to find a mapping between what comes out of the projector and what the camera captures. This video demonstrates how we can detect distorted rectangles in different colors and map their contents to a rectangular canvas.

As you can see, the transformed image jumps around a bit, but keep in mind that both the camera and the projector will be statically mounted in the ceiling (or something), so we won't need to do live calibration in the finished product.