Another Idea - Speech recognition

2-3 years ago I had looked up some work on speech to text conversion.
The approaches were based on Neural networks, and I did not find them helpful.

I dont know the as it is now, but here is the Idea that sprung to my mind yesterday.