This is kind of how DynamicLand is. They use a system of projectors to create images next to objects, and color patterns to track object position and identity with cameras:

So, for example, you can place a keyboard next to a block of text to edit it.

There’s more to DynamicLand than that, but that’s what I’m reminded of.