Kbd-Audio – Tools For Capturing And Analysing Keyboard Input Paired With Microphone Capture

This is a collection of command-line and GUI tools for capturing and analyzing audio data. The most interesting tool is called keytap – it can guess pressed keyboard keys only by analyzing the audio captured from the computer’s microphone.Build instructionsDependencies:SDL2 – used to capture audio and to open GUI windows libsdlFFTW3 – some of the helper tools perform Fourier transformations fftwLinux and Mac OSgit clone https://github.com/ggerganov/kbd-audiocd kbd-audiogit submodule update –initmkdir build && cd buildcmake ..makeWindows(todo, PRs welcome)Toolsrecord-fullRecord audio to a raw binary file on diskUsage: ./record-full output.kbdplay-fullPlayback a recording captured via the record-full toolUsage: ./play-full input.kbdrecordRecord audio only while typing. Useful for collecting training data for keytapUsage: ./record output.kbdplayPlayback a recording created via the record toolUsage: ./play input.kbdkeytapDetect pressed keys via microphone audio capture in real-time. Uses training data captured via the record tool.Usage: ./keytap-gui input0.kbd [input1.kbd] [input2.kbd] …Live demo (WebAssembly threads required)keytap2 (work in progress)Detect pressed keys via microphone audio capture. Uses statistical information (n-gram frequencies) about the language. No training data is required. The ‘recording.kbd’ input file has to be generated via the record-full tool and contains the audio data that will be analyzed. The ‘n-gram.txt’ file has to contain n-gram probabilities for the corresponding language.Usage: ./keytap2-gui recording.kbd n-gram.txtFeedbackAny feedback about the performance of the tools is highly appreciated. Please drop a comment here.Download Kbd-Audio

Link: http://www.kitploit.com/2018/11/kbd-audio-tools-for-capturing-and.html