I like the look of this. Is there any way to control it through your phone (eg through a locally hosted server and a QR code to connect to the page) or an easy way to hook in and send the control signals so I could make crappy version of a page myself?

Privacy.

Both of a microphone and a phone app are serious privacy concerns.