Intelligent input system design based on gesture recognition (Figure)

The Smartmouse intelligent gesture input system is divided into a handheld terminal (gesture data acquisition module) and a host terminal (data reception processing module), and the handheld terminal and the host terminal are connected by wireless. The handheld end can be conveniently worn on the user's finger to collect the user's gesture data; the host side can interface with the PC, and can receive and intelligently process the gesture data.

The functional block diagram of the Smartmouse smart gesture input device is shown in Figure 1.

Smartmouse intelligent gesture input device can accurately recognize various gestures of people and perform corresponding operations such as moving mouse, left button, right button, delete, confirm, cancel, move files, etc. according to gestures. The signal acquisition end can collect the information of the human hand movement in real time, and after sorting, transmit the data to the host end of the PC or the receiver through the 2.4G wireless frequency band in the corresponding data format; the host side can self in itself without any driver. The mouse and keyboard composite device is instantiated as a USB interface; after receiving the data, the data is intelligently processed to recognize the meaning expressed by the gesture, and the corresponding operation is fed back to the PC or the receiver. The recognition rate of gestures should reach the level of consumer electronics.

Design of Intelligent Input System Based on Gesture Recognition

Figure 1 System block diagram

1 system function realization principle

The Smartmouse intelligent input system uses the acceleration sensor to collect and identify the user's hand motion data. Combined with the wireless communication and USB interface technology, the smart hand movement information is passed through the simple and intelligent gesture recognition processing algorithm. The USB interface is transmitted to the PC or the receiver, enabling the user to control the PC in a manner that is more in line with the physical movement habits, giving the user a new operating experience.

The hardware structure of the Smartmouse intelligent input system is shown in Figure 2.

Design of Intelligent Input System Based on Gesture Recognition

Figure 2 system hardware block diagram

(1) Gesture data collection

The handheld end of the Smartmouse intelligent gesture input system needs to continuously and accurately sample the user's hand motion data, and transmit the collected hand motion data to the host connected to the USB interface of the PC through wireless. The system adopts the dual-axis MEMS accelerometer chip MXC6202xMP produced by Mesin as the main gesture sensing device, which achieves low power consumption and high precision while correctly sensing the hand motion data.

(2) Data reception and processing

The host side connected to the USB port of the PC, that is, the data receiving and processing module, instantiates itself as a mouse and keyboard composite device of the PC, and simultaneously intelligently processes the gesture data received by the wireless method through the recognition algorithm, and will process The resulting result is transmitted to the PC in the form of mouse and keyboard operation data. The connection process between the data receiving and processing module and the PC does not require any driver to be installed, and it can be plug and play. The recognition rate of gesture data can meet the requirements of consumer electronics. In this system, the AVR MCU is used as the core processing unit, which is responsible for enumerating the device as a USB composite device according to the USB protocol, managing the wireless transceiver module, and managing the handheld terminal through the wireless module, and simultaneously receiving the received gesture data. The gesture recognition algorithm analyzes and sends the result to the host.

M8 connector

M8 series connectors provides a wide range of metric for small Sensors and actuators.The ingress protection is available and rated to IP 67, these connectors are ideally suited for industrial control networks where small sensors are required. Connectors are either factory TPU over-molded or panel receptacles supplied with sold-cup for wire connecting or with PCB panel solder contacts. Field attachable / mountable Connector is also available for your choice.


M8 Connector,M8 Male Connector, M8 female Connector, M8 shielded connector , M8 angled connector

Kunshan SVL Electric Co.,Ltd , https://www.svlelectric.com