I can understand your project idea.
But to do so , we need to use Native platform mobile application
That's because your targeting technology such as voice recognition and air gesturing need to be done in native platform and using Hybrid, it will not be perfect for your requirement.
For users, Native platform will meet all their types.
IOS , Android , Windows Smart phone , these 3 types of phones are all , so if we developed three types,
there will be no problem.
Let;s discuss more about the project
regards.