Update: M. Arntzenius gave a great talk a few years ago about voice programming using the Talon voice typing system. I don't know how it is that I didn't think of voice typing systems but they're the well-developed answer here. Interestingly Arntzenius confirms a lot of points that I guessed at here (nominalism, integration with language) but also a lot of new ones (like the challenges of resolving ambiguity and handling errors). Two years ago at PNW PLSE, I had a wonderful conversation with ...