Touch screen using audio input?
I really don't know if this is actually possible, but I believe it can be done. As far as possible, make a program that recognizes the various sound bounces from the screen and turns them into a position that will obviously be transmitted to the mouse later.
I know it sounds a little silly, but lately I've noticed that when you touch the screen, it sounds a very boring and strong sound, and this sound changes when he does it in different positions. Perhaps the microphone "hears" differently because the screen acts like a drum with a body. Anyway, who do you think has any audio programming experience?
a source to share
First of all, most internal touchscreens work by detecting pressure based on a cross-linked mesh layer under the display layer.
However, I saw an example where the touch interface was polled on glass of glass, it used 4 microphones to detect the angles, when you tapped on a certain part of the screen, it measures the delay of the sound coming to each microphone, which allows you to triangulate the touch.
This is the methodology you would use, you don't even need to configure the hardware to test it, you can call the interface in VB when you click in the box, it sends out a circular wave and just calculates using the time it takes to reach 4 points. where the pointer is.
EDIT
As suggested, dragging or any gestures would be impossible using the microphone method as the technician needs a wave of sound to detect the entrance.
a source to share